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Abstract — The InterFerence Channel with a Cognitive Relay 
(IFC-CR) consists of the classical interference channel with two 
independent source-destination pairs whose communication is 
aided by an additional node, referred to as the cognitive relay, 
that has a priori knowledge of both sources' messages. This 
a priori message knowledge is termed cognition and idealizes 
the relay learning the messages of the two sources from their 
transmissions over a wireless channel. This paper presents new 
inner and outer bounds for the capacity region of the general 
memoryless IFC-CR that are shown to be tight for a certain 
class of channels. The new outer bound follows from argu- 
ments originally devised for broadcast channels among which 
Sato's observation that the capacity region of channels with 
non-cooperative receivers only depends on the channel output 
conditional marginal distributions. The new inner bound is shown 
to include all previously proposed coding schemes and it is thus 
the largest known achievable rate region to date. The new inner 
and outer bounds coincide for a subset of channel satisfying a 
strong interference condition. For these channels there is no loss 
in optimality if both destinations decode both messages. This 
result parallels analogous results for the classical IFC and for 
the cognitive IFC and is the first known capacity result for the 
general IFC-CR. Numerical evaluations of the proposed inner 
and outer bounds are presented for the Gaussian noise case. 

Index Terms — Capacity; Inner bound; Interference channel 
with a cognitive relay; Outer bound; Strong interference; Weak 
interference; 



I. Introduction 

THE information theoretic study of cognitive networks - 
networks in which a subset of the nodes has a priori 
knowledge of the messages of other subsets of nodes - has 
focused mostly on the two user Cognitive InterFerence Chan- 
nel (CIFC), i.e., a variation of the classical two-user IFC where 
one of the transmitters has non-causal a priori knowledge of 
both messages to be transmitted. While idealistic, this form of 
genie-aided cognition has provided significant insights of the 
rate advantages obtainable through asymmetric or unilateral 
transmitter cooperation (please refer to |1| and f2l, and ref- 
erences therein, for an extensive summary of available results 
for the general and Gaussian CIFC, respectively). 

In this paper we study a natural extension of the CIFC 
where the genie-aided cognition, instead of being provided 
to only one of the sources of the IFC, is rather provided to 
a third node, referred to a the cognitive relay, that aids the 
communication between both source-destination pairs. One of 
the key challenges of this model is the issue of interference 



management at the cognitive relay. Unlike in the Broadcast 
Channel (BC) and the CIFC, the cognitive relay in an IFC-CR 
has knowledge of the interference seen at each destination but 
has no control over the interfering signals that are sent by the 
sources. Gel'fand-Pinsker binning O, or Dirty Paper Coding 
(DPC) for Gaussian channels |4l, is a celebrated well-known 
technique used to mitigate interference known non-causally 
at a source through proper pre-coding of the message. This 
strategy is known to be capacity achieving for certain classes 
of BCs and CIFCs. In the IFC-CR, the cognitive relay can 
only manage the interference experienced by the destinations 
through its own transmissions, begging the question of how 
this single transmission may best be used to simultaneously 
aid both source-destination pairs. 

The IFC-CR model encompasses many previously studied 
multi-terminal networks as special cases: the BC, the classical 
IFC and the CIFC, none of whose capacity is known in 
general. The generality of the IFC-CR model suggests a certain 
level of complexity in the analytical results, but also allows 
one to study whether and how results available for smaller 
networks may be incorporated into larger networks. For in- 
stance, the derivation of inner and outer bounds for the general 
memoryless IFC-CR carefully combines ideas developed for 
simpler networks, such as Gel'fand-Pinsker binning and genie- 
aided outer bounds, adjusted to this more general network 
setting. We seek to determine whether these extensions of 
previously proposed techniques to our more general channel 
is sufficient to achieve capacity (we answer this in the positive 
for a subset of the strong interference regime) or whether 
our model is sufficiently different such that it requires new 
transmission techniques to achieve capacity. 



A. Past Work 

The information theoretic capacity of the general mem- 
oryless IFC-CR remains an open problem for the general 
case. The IFC-CR was initially considered in ISj where 
the first achievable rate region was proposed, and was later 
improved upon in JH for the Single-Input Single-Output 
(SISO) Gaussian channel. The authors of |6| also provided 
a sum-rate outer bound for the Gaussian channel based on an 
outer bound for the Multiple-Input Multiple- Output (MIMO) 



Gaussian CIFC. In fTQ a general achievable rate region was 
derived that contains all previously known achievable rate 
regions in O, JS]. The first outer bound for a general (i.e. 
not necessarily Gaussian) IFC-CR was derived in (SI by using 
Sato's observation that the capacity region of channels with 
non-cooperative receivers depends only on the conditional 
marginal distribution of the channel outputs ||9l. This general 
Sato-type outer bound was further tightened in O for a class 
of semi-deterministic channels in the spirit of ifTOl . For the 
special case where the sources do not interfere at the non- 
intended destinations, the tightened bound of |8| was shown 
to be capacity for the deterministic approximation of the 
Gaussian IFC-CR at high-SNR lEl and to be optimal to 
within 3 bits/sec/Hz for any finite SNR fT?]. Furthermore, for 
a subset of parameters akin to the weak interference regime 
for the classical IFC, the tightened bound of |8| was shown 
to be capacity for the general deterministic approximation of 
the Gaussian IFC-CR at high-SNR; the achievability in this 
case suggests an interesting transmission strategy where the 
cognitive relay is able to "pre-cancel" the interference at both 
destinations simultaneously. 

The channel model under consideration in this work is 
closely related to the interference relay channel: an IFC 
with an additional relay node which does not have a priori 
knowledge of the sources' messages, but rather learns these 
messages over the noisy channel between the sources and 
the relays |13|. Although more realistic than the IFC-CR 
considered here, the interference relay channel is harder to 
study due to the causal cognition. Recently new results were 
derived for the interference relay channel where the relay is 
assumed to operate out-of-band lfT4l . ifTSl . i.e., a model in 
which the link between the relay and the destinations does not 
interfere with the underlaying IFC between the sources and the 
destinations; in this case, capacity is known to 1.15 bits/s/Hz 
in the symmetric Gaussian noise case [14J. 

The IFC-CR subsumes several well studied channel models 
as special case. The CIFC El that is, an IFC in which one 
transmitter has non-causal a-priori knowledge of the messages 
of both transmitters, may be obtained from the IFC-CR by 
eliminating the channel input of one of the sources. The CIFC 
was first considered from an information theoretic perspective 
in 1 16], where the channel was formally defined and the 
first achievable rate region was obtained. The largest known 
achievable rate region is due to Rini et al. |[T9l , |[ll and 
the tightest outer bound to Marie et al ll20ll . Capacity has 
been established for channels with "very weak interference" in 
which (in Gaussian noise) treating interference at the primary 
receiver as noise is optimal lITSl . El J, for the "very strong 
interference" regime, where without loss of optimality both 
receivers can decode both messages and the cognitive channel 
reduces to a compound Multiple Access Channel (MAC) ifTTll . 
for the "better cognitive decoding" regime ll22ll . Q where the 

^The authors of |7 1 refer to the IFC-CR as "broadcast channel with cognitive 
relays", arguing that the model can also be obtained by adding two partially 
cognitive relays to a broadcast channel. 

^The CIFC has also been referred to as the cognitive channel |16|, an 
interference channel with "unidirectional cooperation" 1 171 and an interference 
channel with "degraded message sets" fTsl . 



cognitive receiver can decode both messages without loss of 
optimality, for the semi-deterministic CIFC |23|, [IJ where a 
BC-type coding scheme is optimal, and for certain Gaussian 
CIFC without interference at the primary decoder ll24ll . ll2ll . 
For the general Gaussian CIFC capacity is known to within 
1 bit/s/Hz and to within a factor 2 regardless of channel 
parameters ll23ll. 121. 1251. 

The classical BC can be obtained from the IFC-CR by 
eliminating the channel inputs of both sources. The capacity of 
the general BC is unknown. The largest known achievable rate 
region is due to Marton fSSl and the tightest outer bound to 
Nair and El Gamal |27|. In all cases where capacity is known 
Marlon's region is optimal (see |28| and references therein for 
an extensive discussion of all cases where capacity is known 
and for the challenges in determining capacity in the open 
cases). Many techniques originally developed for the BC will 
prove useful for the derivations in this work. 

Finally, the classical IFC can be obtained from the IFC- 
CR by eliminating the channel input of the cognitive relay. 
The largest known achievable rate region is due to Han and 
Kobayashi ll29l , which is optimal in all cases where capacity 
is known (see ll30l and references therein for an extensive 
discussion of all cases where capacity is known). In Gaussian 
noise, capacity is known only in strong interference [ 3l1l . 
ES, EH and known otherwise to within 1 bit/s/Hz |34l. 
Some techniques originally developed for the IFC, such as 
rate splitting and simultaneous decoding, will be adapted to 
the IFC-CR model in this work. 

B. Paper Main Contributions 
In this paper we determine: 
1) Outer Bound: 

a) Sato-type outer bound. 

This outer bound uses Sato's observation |9| that the 
capacity of a channel with non-cooperative receivers only 
depends on the channel output conditional marginal dis- 
tributions. This bound does not contain any auxiliary 
random variables and is thus computable in principle by 
determining the optimal distribution of the channel inpus . 

b) BC-type outer bound. 

This outer bound generalizes the tightest known outer 
bound for the general CIFC by Marie et al. 1201 to the 
general IFC-CR. It uses a technique originally developed to 
prove the converse for the "more capable" BC in |[35l and 
later generalized to obtain an outer bound for the general 
BC in |27|. This BC-type outer bound is the tightest known 
to date for the general IFC-CR. It is however expressed as 
a function of three auxiliary random variables for which no 
cardinality bound exists on the corresponding alphabets. 

c) A simplification of the BC-type outer bound in the 
"strong interference" and "weak interference" regimes. 
The "strong interference" regime is defined as the regime 
where, loosely speaking, the non-intended destination can 
decode more information than the intended destination even 
after having removed the interfering signal. This regime 
parallels the "strong interference" regime for the IFC 
and for the CIFC |S3. 



The "weak interference" regime is defined as the regime 
in which, loosely speaking, treating interference as noise 
is optimal. This regime parallels the "weak interference" 
regime for the IFC in (21, (H, (33 and for the CIFC 
in 1 18 1. 

2) Inner Bound: 

a) Largest known inner bound. 

Our inner bound is shown to include all previously pro- 
posed inner bounds as special cases. This region equals 
the capacity region when the channel reduces to a simpler 
model (i.e. BC, IFC and CIFC ) for which capacity is 
known. The novel ingredients are a rate- split in four parts 
of the source messages and a very structured nesting of 
superposition and binning. Although the expression of the 
inner bound is rather involved, it provides a unifying 
framework to evaluate the effect of different transmission 
strategies on the achievable rate region. 

b) The Fourier-Motzkin elimination of the proposed inner 
bound in several sub-cases. 

The Fourier-Motzkin elimination of our general inner 
bound region appears difficult to reduce to a manageable 
number of rate bounds. We therefore proceed to analyze 
several simpler achievability schemes. Besides being of use 
in numerically evaluating regions, the simpler regions are 
extensions of regions known to achieve capacity when the 
channel reduces to an IFC or a CIFC. 

3) Capacity: 

a) Capacity in the "very strong interference" regime at 
one destination. 

This is a subset of the "strong interference" regime under 
which our general BC-type outer bound can be simplified. 
In this regime both decoders can, without loss of optimal- 
ity, decode both messages as in a compound MAC. The 
"strong interference" outer bound may be achieved using 
superposition coding without rate splitting or binning. 

b) Capacity in the "strong interference at both receivers" 
regime. 

A corollary of the previous capacity result where both 
destinations experience "very strong interference". 

4) Gaussian Channels: 

a) Capacity in the "very strong interference" regime at 
one destination and in the "strong interference at both 
receivers" . 

We determine the set of channel coefficients that satisfy the 
condition of "very strong interference" at one destination 
and of "very strong interference" at both destinations, 
thereby establishing capacity in these cases. 

b) Outer bound for the degraded IFC-CR. 

For a special class of channels that satisfies the "weak 
interference" condition under which our general BC-type 
outer bound could be simplified, we evaluate the outer 
bound in closed form. Unfortunately, we have not been 
able to find a transmission scheme that achieves this outer 
bound yet. 

c) Numerical evaluations of the proposed simpler achiev- 
able rate regions. 



These evaluations visually illustrate the relationships be- 
tween the derived inner and outer bounds for the cases 
where capacity is open. 

C Paper Organization 

In Section [III we formally define the general memoryless 
IFC-CR. In Section |llll we proceed to derive our new outer 
bounds, two of which hold in general, and two of which 
are valid under "strong interference" and "weak interference" 
conditions, respectively. In Section |IV] we derive a general 
achievable rate region for the IFC-CR and analytically show 
that this contains all other known inner bounds; we further 
simply our general inner bound in a number of simpler sub- 
cases with a limited number of auxiliary random variables 
and rate splits. In Section |V] we prove capacity for the IFC- 
CR in the "very strong interference" regime; this is the first 
general capacity result for the IFC-CR and parallels results 
for similar regimes for the IFC and the CIFC. In Section |Vl] 
we numerically illustrate the "very strong interference" ca- 
pacity region and the "weak interference" outer bound for 
the Gaussian IFC-CR, as well as numerical results comparing 
several of the simplified inner bounds. We conclude the paper 
in Section [Vnll 

II. Channel Model 

We consider the channel model depicted in Fig. [T] In the 
IFC-CR the transmission of the two independent messages Wi 
uniformly distributed on [1 : 2^^^], i G {1,2}, block-length 
A^ G Z+, and rates Ri G M+, is aided by a single cognitive 
relay, whose input to the channel has subscript c. We define 
Xi^n and Yi^n to be the input and output of the channel for the 
z-th source-destination pair at the n-th channel use, i G {1,2}, 
n G [1 : N], and define X^ ^ := [Xij,Xij+i, • • • ,Xi^k] for 
k > j, and similarly for yJ^j. The channel is assumed to be 
memoryless with transition probability Pyi,Y2\Xi,X2,Xc- Since 
the destinations do not cooperate, the capacity of the mem- 
oryless IFC-CR is only a function of the output conditional 
marginal distributions Py^\Xi,X2,x, and Py2\x^,X2,x,' 

A non-negative rate pair (i?i, i?2) is said to be achievable 
if there exists a sequence of encoding functions 
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The capacity region is defined as the closure of the region of 
all achievable (i?i,i?2) pairs. 

Note that the IFC-CR subsumes three well-studied channels 
as special cases: 
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Fig. 1. The general memoryless IFC-CR channel model. 



. IFC: for X^ = 0, 
. CIFC: for Xi = or X2 = 0, and 
. BC: for Xi = X2 = 0. 

The capacity region of the general IFC-CR is unknown in 
general. 

III. Outer Bounds 

In this section we present two new outer bounds which we 
term the Sato-type and the BC-type outer bound. The names 
of these bounds reflect the channels and/or techniques which 
inspired them. We then proceed to simplify the expression 
of these bounds in the "strong interference" and "weak in- 
terference" regime |j As the IFC-CR generalizes a number of 
multi-user channels such as the CIFC, the IFC and the BC, one 
expects techniques relevant in those channels to be of use in 
the IFC-CR, and conversely, the IFC-CR outer bounds should 
reduce to capacity of the simpler sub-channels when they are 
known. Indeed, our outer bounds generalize the underlying 
sub-channels, as shown in Table U 

A. Sato-type Outer Bound 

We start with the outer bound for the general IFC-CR first 
derived by the Rini, Tuninetti and Devroye in |8, Thm.3.1]. It 
uses Sato's argument ^ that the capacity region of the IFC- 
CR only depends on the channel output conditional marginal 
distributions since the destinations do not cooperate. 

Theorem III.l. If {Ri^R2) lies in the capacity region of the 
IFC-CR, then the following must hold for any Yi and I2 
having the same conditional marginal distributions as Yi and 
Y2, respectively, but otherwise arbitrarily correlated: 

Ri<I{Yv,Xi,Xe\X2,Q), (la) 

R2<I{Y2;X2,Xe\Xi,Q), (lb) 

Ri + R2 < I{Y2;X,,X2,X,\Q) + I{Y,;X,,XM,X2,Q), 

(Ic) 

Ri + R2 < I{Yv,X,,X2,X,\Q) + I{Y2;X2,Xe\Y\,Xi,Q), 

(Id) 

^ We note that our naming convention is not entirely consistent with past 
uses of the term "strong/weak interference". Here, as in our previous work 
on the CIFC |1 1, |2|, we use "strong/weak interference" to denote regimes 
inspired by similar results for the IFC under which we may obtain either a 
tighter or simpler outer bound for the channel of interest, and use the terms 
"very strong/very weak" to denote regimes in which additional conditions 
(therefore forming subsets of the "strong/weak" regimes) are imposed on top 
of the "strong/weak" conditions that allow these outer bounds to be achieved. 



for some input distribution that factors as 

Pq,Xi,X2,x, = PqPxi\qPx2\qPx,\Xi,X2,Q' (2) 

Proof: The proof may be found in Appendix |A1 ■ 

The outer bound of Thm. IIII.ll has the appealing feature 
that is does not contain any auxiliary Random Variable (RV) 
and is thus computable. For example (see Section IVll) the 
"Gaussian maximizes entropy" principle suffices to show that 
a jointly Gaussian input exhausts the outer bound of Thm. lTlI.ll 
for the Gaussian noise channel. It also gives the capacity in 
several cases (please refer to Table IB). However it does not 
reduce to the other cases where capacity is known for simpler 
channels subsumed by the IFC-CR (please refer to Table U) nor 
to the tightest known outer bounds for the general CIFC and 
BC. To remedy this, we next derive an outer bound by using 
a bounding technique originally developed for the BC |35| . 
The derived bound indeed reduces to the tightest known outer 
bounds for the general CIFC |20| and the general BC ll27ll 
when the IFC-CR reduces to these channel models. 

B. BC-type outer bound 

The outer bound in |20| for the CIFC and in ||27i for the 
BC use in their bounding steps the Csiszar's sum identity BOll . 
We extend this technique here to the general IFC-CR. 

Theorem III.2. If (i?i,i^2) lies in the capacity region of the 
IFC-CR then the following must hold 



Ri<I{Yi;Xi,X,\U2,X2), 
R2<I{Y2;X2,X,\UuXi), 
Ri<I{Yv,V,Ui,Xi), 

R2<I{Y2;V,U2,X2), 



(3a) 
(3b) 
(3c) 
(3d) 



(3e) 

Ri ^ R2 < I{Yi;V,UuX,) ^ I{Y2; ,X2,X,\V,UuX,), 

(3f) 

such that 

V ^ {UuU2) ^ (Xi,X2,X,) ^ {YuY2) (4) 

for some input distribution that factors as 

Pui,U2Y,Xi,X2,Xc 

= PuiPu2Pv\Ui,U2Pxi\UiPx2\U2Px,\Ui,U2- (5) 
Proof: The proof may be found in Appendix |B] ■ 



Remark III. 3. Thm. IIII.2l is the tightest known outer bound for 
a general IFC-CR and 

1) it reduces to the tightest known outer bound for the gen- 
eral BC without common rate |27| when Xi = X2 = 0, 
which is tight for all cases where capacity is known. 

2) it reduces to the tightest known outer bound for the 
general CIFC EqI Thm.4] when Xi = 0, which is tight 
for all cases where capacity is known. The outer bound 
in (201 Thm.4] is tighter than the one in |T8, Thm. 3.2] 
(see ®, Remark 6]). We can obtain the equivalent of the 
outer bound in (TSl Thm. 3.2] by defining in Thm. IIII.2I 



TABLE I 
The outer bounds presented in this work and their relationship to underlying simpler channels where capacity is known. 



Outer bound and Theorem in this work 



Capacity result 



Reference 



Thm.lV.ll 
137 Thm.6] 
(22] Thm.3.1] 

d a, EH, oa 

|18 Thm. 3.2] 
|2 Thm. 7.1] 
El Thm. 8.1] 
Ei Sec. 3] 

[?] E 



Sato-type outer bound 



"strong interference" IFC-CR 
Gaussian "strong interference" CIFC 
Gaussian "primary decodes cognitive" CIFC 
"strong interference" IPC 



BC-type outer bound 



"very weak interference" CIFC 
"better cognitive decoding" CIFC 
semi-deterministic CIFC 
more capable BC 
semi-deterministic BC 



a new pair of auxiliary RVs [/^ := [V, U2], U[ := [V, U2] 
and then reasoning as in [20, Remark 6]. 

3) it is tighter than Thm. IIII.ll In fact, the region in 
Thm. nil. 2I can be enlarged by dropping ([3cl)-(l3dl). More- 
over, the bound in (l3al) is tighter than the one in ([Tal) by 
the "conditioning reduces entropy" principle. Similarly, 
to (H Remark IV. 2] the sum-bound in ([3el) is tighter than 
the bound in (fTcl) . However, the region in Thm. IIII.2I 
is expressed as a function of three auxiliary RVs for 
which we have not obtained cardinality bounds on the 
respective alphabets, while the looser region in Thm. lIII.T] 
is expressed only as a function of the inputs and is thus 
computable in principle. 

4) Thm. lIII.fl neither reduces to the capacity region of a class 
of deterministic IFCs studied in ll33l nor reduces to the 
outer bound for the semi-deterministic IFC in 1 10] when 
Xc = 0. The difficulty in deriving outer bounds for the 
general IFC-CR that are tight when it reduces to an IFC 
is also noted in |8|. The authors of |8, Thm.3.2] were 
able to derive tight bounds in this scenario by imposing 
additional constraints on the effect of interference on the 
channel outputs. 

C Simplified BC-type outer bound in the ''weak interference " 
and ''strong interference'' regimes 

We next proceed to simplify the proposed BC-type outer 
bound under specific "strong interference" and "weak inter- 
ference" conditions. 

Corollary III.4. "Strong interference at Rx 1" outer bound. 

I{Y2;X2,X,\Xi) < /(Fi;X2,Xe|Xi) (6) 

for all distributions that factor as 

Pxi,X2,x, = PxiPx2Px,\Xi,X2^ C^) 

then, if (i?i,i?2) lies in the capacity region of the IFC-CR, 
the following must hold 

Ri<I{Y,;Xi,X,\X2,Q), 
R2<I{Y2;X2,Xe\Xi,Q), 

Ri + R2<I{Yi;Xi,X2,Xe\Q), 

for some distribution that factors as in (O. 



(8a) 
(8b) 
(8c) 



Proof: The proof follows from showing that under the 
condition in (|6]) the sum-rate bounds in Thm. IIII.2I simplify 



to (l8cl) . The details of the proof may be found in Appendix O 

■ 

Note that, given the symmetry of the channel model. 
Cor. IIII.4I also holds by reversing the role of the sources. 
Although not valid for a general IFC-CR, Cor. IIII.4I is ex- 
pressed only as a function of the channel inputs and does not 
contain auxiliary RVs as Thm. IIII.ll which simplifies both the 
calculation of the outer bound and the derivation of a capacity 
achieving encoding strategy. 

Corollary III.5. "Weak interference at Rx 2" outer bound. 

// 

I{Y2;U\X2)<I{Yi;U\X2) (9) 

holds for all distributions 

Pu,Xi,X2,x^ = PxiPx2Px,\Xi,X2Pu\Xi,X2,x,, (10) 

such that U -> (Xi,X2,Xc) -^ (^1,^2), then, if {Ri,R2) 
lies in the capacity region of the IFC-CR, the following must 
hold: 

Ri<I{Y^-X^,X,\X2,U) (11a) 

R2<I{Y2;X2,U) (lib) 

R2<I{Y2;X2,Xc\Xi) (lie) 

for some distribution that factors as in (fTOl) . 

Proof: The proof may be found in Appendix (D] ■ 

Again, given the symmetry of the channel model. Cor. IIII.5I 
also holds when the sources are reversed. 

IV. Inner Bounds 

In this section we derive an inner bound for a general IFC- 
CR, then analytically show that this region contains all other 
previously derived regions, and finally derive simple and easy- 
to-understand expressions for a number of sub-schemes of 
our general inner bound. Given the generality of the IFC- 
CR channel model, the coding scheme we propose contains 
a large number of rate bounds and several auxiliary RVs. 
Unfortunately, this is unavoidable if one wishes the achievable 
scheme to be capacity in all the cases when the channel 
reduces to one where capacity is known. Our aim in deriving 
this achievable rate region is therefore mainly to provide a 
unified framework to efficiently investigate the rate advantages 
provided by different transmission strategies. 



A. General achievable rate region 

The achievable scheme is obtained as a combination of the 
following well established random coding techniques: 

• Rate-splitting: This refers to splitting the message of a 
source into different independent sub-messages, one for 
each possible subset of destinations. Rate splitting was 
first introduced by Han and Kobayashi for the classical 
IFC II29II (referred to as the Han and Kobayashi region or 
rate- splitting from now on) and is a fundamental tool in 
achieving capacity in a number of cases when combined 
with superposition coding and binning. In our achievable 
scheme we rate split each message into private and public 
parts at the intended transmitter and at the cognitive relay. 

• Superposition coding: Superposition coding was first 
introduced in 141 J for the degraded BC and intuitively 
consists of generating codewords conditional on other 
ones, or "stacking" codewords on top of each other. Des- 
tinations in the system decode (some of the) codewords 
starting from the bottom of the stack, while treating the 
remaining codewords as noise. Thus, a given message 
may be decoded at one destination but treated as noise at 
another. Here we superpose public messages to broadcast 
messages and the messages known at the cognitive relay 
over the messages at the two sources. 

• Gel'fand-Pinsker binning: Often simply referred to 
as binning ll42ll . it allows a transmitter to "pre-code" 
(portions of) the message against the interference that 
message is known to experience at a destination. Binning 
is also used in Marton's largest known achievable rate 
region for the general memory less BC ll26ll . It is also a 
crucial element in other channels, usually with some form 
of "broadcast" element, including the CIFC [IJ. In this 
achievable scheme the cognitive relay performs binning 
against the private messages of the sources. 

• Simultaneous decoding: As at the destination of a 
MAC, a destination jointly decodes its intended message 
and some of the sub-messages of non-intended sources 
with the objective to reduce the level of interference. 
Simultaneous or joint decoding is optimal in many cases 
of "strong" interference. 

We next derive a transmission scheme that contains a 
general combination these encoding techniques. By removing 
certain features from this general scheme, one can quickly 
obtain simpler and analytically more tractable sub-schemes 
that can be compared to each other and to outer bounds, as 
we shall do in the next subsection. We shall also show that 
this general inner bound includes all known to-date achievable 
rate regions. The novelty of our proposed region, which will 
allow us to show inclusion in all known regions, is a rate split 
into four parts for each source message (as opposed to the 
classical rate split in two parts for the classical IFC [29| and 
to the rate split in three parts for the CIFC Q). 

Theorem IV.l. Region IR^^^^^). The region :R(^tdg) -^ 
defined as the set of non-negative rate pairs {Ri , R2 ) for which 



there exists a non-negative rate vector 

{Rlcj R2C-, Rip J ^2p, ^Icb, ^2cb, ^Ipb, ^2pb, ^Ocb' ^Ipb' ^2pb) 

e\J{JionJlinJi2} (12) 



p 

such that 



rCi — -LLj. 



RiA 



.^ -R^cb + i^^pb, ^^{1,2}, (13) 

where the union in ([T2l) is over all input distributions P given 
by 

P =PqPuic,Xi\qPu2c,X2\Q 

^f/lpb,f/2pb,f/0cb,X,|C/ie,Xi,C/2c,X2,Q5 (14) 

where the ''binning rate region" IRq in ([T2l) is given in (fTSl) 
and the ''decoding rate region at destination 1 " ^i in ([T2l) is 
given in ([T6b for 



Liph 
Loch 



-^ipb 
^Icb 



JDf 

-^ipb' 
^2cb 



e{l,2}, 



R'r 



Ocb7 



and where the "decoding rate region at destination 2" ^2 
in ([T2I) is obtained permuting the indices 1 and 2 in the 
"decoding rate region at destination 1 " IRi in ([T6l) . 

Moreover, in the "decoding rate region at destination 1 " IRi 
in ([T6b (and similarly for ^2 but with the role of the sources 
swapped) the following rate bounds can be dropped 

• (I16ab and (I16bb .- when Ri = Ric = Rip = i^icb = 

^Ipb = 0, 

• (I16cb and (I16db ." when Rip = Rich = ^ipb = 0. 

• (I16el) and (I16fl ." when Rich = ^ipb = 0. 

• ( 16g| ).- when Rip = Riph = 0, 

• (I16hl) .- when Riph = 0, 

because these bounds correspond to an error event in which 
a non-intended common message or a bin index is incorrectly 
decoded and no other intended message is incorrectly decoded. 

Proof: The achievable rate region in ([T2b may be obtained 
using the result in 1431 by specifying how rate splitting, 
binning and superposition coding are performed. The details 
of the proof are reported in Appendix |E1 for completeness. In 
what follows we sketch the main elements of the encoding 
and decoding procedures and we give an intuitive explanation 
about the proposed choices. We do not consider the time 
sharing RV Q to simplify the description. 

Rate Splitting: The message Wi, i G {1,2}, is split into 
four sub-messages: 

• Private message Wip of rate Rip, 

• Common message Wic of rate Ric, 

• Common Broadcasted message Wich of rate Rich, and 

• Private Broadcasted message Wiph of rate Riph, 
so that (O holds. 

Codebook Generation: The sources and the cognitive relay 
generate the following codebooks: 

• Common message: Wic G [1 : 2^^*^=] is encoded into 
U^{wic) with iid distribution Pf/,^, i G {1,2}. 

• Private message: for a given Wic, Wip G [1 : 2^^^ 



IS 



encoded into Xf" {wip\wic) with iid distribution Pxi\Uic 
(i.e., X[^ is superimposed to U^), i G {1,2}. 



-Rocb — H^l^^2',Uocb\Uic,U2c,Q) 
-Rlpb ^ I {^2', Uipb\Uic, Xi,U2c, Uoch, Q) 
-^2pb — -'^(-^i; t^2pb|t^lc, X2, U2c, Uoch, Q) 
-^Ipb + -^2pb ^ -^(-'^2; t^lpb|t^lc, U2c,Xi,Uoch,Q) + H^T-'j f^2pb|t^lc, f^2c,-'^2, Uoch,Q) 
+ I{Ulpb', f^2pb|f^lc,-'^lj U2c,X2,Uocb,Q), 



(15a) 
(15b) 
(15c) 

(15d) 



Rlc + Rip + i?2c + Loch + Liph < I{Uocb; ^1 |C/lc, U2c, Q) + I{Yi 

Ric + Rip + Locb + Lipb < I{Uocb; Xi\Uu, U2c, Q) + I{Yi 

Rip + R2c + Locb + iipb < I{Uocb; Xi\Uic, U2c, Q) + I{Yi 

Rip + J^Ocb + ilpb < -^(t^Ocb; -^1 |t^lc, U2c, Q) + -'"(^L 

i?2c + iocb + i^lpb < I{Uocb] Xi\Uic, U2c, Q) + I{Yl 

Locb + i^ipb < I{Uocb;Xi\Uic,U2c,Q) + liYi 
Rip + Lipb < I{Uocb; Xi\Uu, U2c, Q) + I{Yi 



L 



Ipb 



< 



Uic,U2c,Xi,Uoch,Uipb,Q) (16a) 

Uu,Xi,Uocb,Uipb\U2c,Q) (16b) 

C/2c,^i,/7ocb,f^ipb|f^ic,Q) (16c) 

Xi,Uocb,Uipb\Ui,,U2c,Q) (16d) 

C^2c,f/ocb,f/ipb|C^ic,^i,Q) (16e) 

C/0cb,f/lpb|f/lc,C/2c,Xl,Q) (16f) 

^l,f/lpb|f/lc,[/2c,[/0cb,Q)) (16g) 

(16h) 



I{Yl', Uiph\Uic,U2c,Xi, Uocb,Q), 



given pair 

x[l: 



Common broadcasted messages: for a 

{wic,W2c), the pair (^icb,^2cb) ^ [1 : 2^^^-^ 
2^^2cb] is encoded into t/(^b(^icb,^2cb, ^0cbkic,^2c), 
^ocb e [1 : 2^^ocb], with iid distribution Puoc^\u,.,U2c' 
broadcasted message: for a 

(^Ic, ^2c, ^Icb, ^2cb, ^Ocb, , ^ip), 

G [1 : 2^-^^p^] is encoded into 



Private 
given 

^ipb 

Ul^u{Wiph, ^ipbklc, ^2c, ^Icb, ^2cb, ^Ocb, ^ip), 



ipb 

^ipb 
tdN 

-L 1 



2^^Ul 



with distribution 



€{1,2}. 



e [1 

Encoding: The cognitive relay has knowledge of both mes- 
sages Wi , W2 and is thus able to perform binning with the goal 
to create the most general distribution among conditionally 
independent RVs/codebooks. It does the following: 

• ^Ocb ^^^ generated only based on {U^^^ ^2^)- The cog- 
nitive relay bins U^^^ against (Xf^,X2^), as for channel 
with states known non-causally at the encoder p2l, to 
make it look like it were generated iid with distribution 



UQch\^l)^2^Uic,U2c 



For this to be possible, the "binning 
rate" i?Q^^ must satisfy (I15al) . 

t/j^^, resp. /7^i3, was generated independently of 
{X2 ^ ^2^b)' ^^^P- {^1 ^ ^i^b)' conditioned on the "com- 
mon" RVs (^1^, ^2^, ^(^b)- The cognitive relay bins 
C/j^b ^^^ ^2^b against each other, as in Marton's region 
for the general BC EH, and against (Xj^, X^) to make 
them look like they were generated iid with distribution 
^f/ipb,f/2pb|Xi,X2,c/ic,f/2c,f/ocb- For this to be possible, the 
"binning rate" pair (^ipb5^2pb) i^^^t satisfy (I15bb - 
([Bdt . 
to send Wi = (i^ic, '^ip, '^icb, '^ipb) source i sends 




Fig. 2. A graphical representation of the coding scheme for the inner bound 
region in Section |IV] The RVs for message 1 are in blue diamond boxes 
while the RVs for message 2 are in red square boxes. A solid line among 
RVs indicates that the RVs are superposed while a dashed line that the RVs 
are binned against each other. 



to send {wi,W2) = ((^ic,^ip,^icb,^ipb), 
(^^2c,^2p,^2cb,^2pb)) the cognitive relay sends 
X^ obtained as a deterministic function of the tuplet 

(f/i^,f/2^,Xi^,Xf,f/o^i,,t^i^b,t^2^b) found after the 
different binning operations. 



Fig. [21 is a graphical representation of the proposed achiev- 
able scheme. Each box represents an auxiliary RV/codebook 
carrying the sub-message with the same subscript (note 
that the RVs Xi and X2 carry the sub-messages l^ip and 
W2p, respectively, and Uoch carries the pair of sub-messages 

(l^lcb,1^2cb)). 

Decoding: Destination i, i G {1,2}, simultaneously de- 
codes all RVs/codebooks except (X^, U^ ) with i ^ i. This 
is successful with high probability if the rates belong to the 



"decoding rate region at destination z" % defined in ([T6l) , 
ZG{1,2}. ■ 

Remark IV. 2 (Intuitive interpretation of the proposed cod- 
ing scheme). Loosely speaking the achievable rate region 
is obtained by considering a Han and Kobayashi transmis- 
sion scheme for the IFC among the two source-destination 
pairs and extending this coding scheme with the scheme 
for the CIFC |19| for each source-destination pair. The 
RVs t/ic, ^2c, -^1,-^2 correspond to the Han and Kobayashi 
scheme ll29ll for the IFC. The common broadcasted message 
Uoch is superposed to both the common messages Uic^ U2c 
and carries the common broadcasted messages for both users, 
I^icb and W2ch- Since these messages are to be decoded 
at both decoders, there is no rate advantage in assigning a 
different RV to each rate split. Note that /7ocb cannot be 
stacked over to the private messages (Xi,X2) since these 
messages are not decoded at the non-intended destinations. 
To achieve the most general input distribution, the cognitive 
relay performs binning of Uoch against the known interfering 
signals (Xi,X2). The private broadcasted message /7ipb is 
stacked onto (/7ic, /72c, ^ocb,-^i) - this can be done since 
this RV is to be decoded only at destination 1 which also 
decodes Xi. The same procedure is applied to t/2pb- At the 
last encoding step at the cognitive relay, /7ipb and U2ph are 
binned against each other and against the non-intended private 
messages to achieve the most general distribution. 

Finally, note that the proposed scheme with only the 
"broadcast" RVs (t/ocb, ^ipb, ^2pb) corresponds to Marton's 
achievable rate region for the general BC |26|, without the 
"broadcast" RVs it corresponds to Han and Kobayashi 's 
achievable rate region for the general IFC |29|, and with 
the "broadcast" RVs only for one source it corresponds to 
Rini et aPs achievable rate region for the general CIFC Q. 
Therefore, our proposed achievable rate region reduces to the 
largest known achievable rate regions for the simpler channels 
subsumed by the IFC-CR, which are capacity-achieving for all 
cases where capacity is known. 



B. Inclusion of the Jiang et ah region [T] for the IFC-CR: 
scheme with (/7ic, Xi, /72c, ^2, /7ipb, /72pb) 



C Sub-schemes from the general achievable rate region in 
Thm.UvJ\ 



We now show that the achievable rate region in Thm. IIV.II 
includes all previously proposed achievable rate regions for the 
IFC-CR by showing that the region in Thm. IIV.II includes the 
region in [Tl as a special case, which is currently the largest 
known region for this channel and contains the regions of |i5l 
and (61 . 

Theorem IV.3. The achievable rate region in Thm. \iy.l\ 
contains the achievable rate region in [7. (21)-(31)]. 



Proof: Set Uoch = in Thm. IIV.II The resulting achiev- 
able rate region includes the region in |7, (20)-(31)] (which 
includes the region in 17, (1)-(19)]) as shown in Appendix IB 



The inner bound of Thm. II V. T1 provides a unified framework 
from which we may derive simpler inner bounds that may 
be more easily manipulated and understood. In particular one 
would like an achievable rate region to be expressed in terms 
of the rate bounds directly on Ri and R2 rather than on 
the rates corresponding to the rate-split messages. Such a 
region may be obtained by eliminating the sub-rates from the 
rate region expression using the Fourier-Motzkin elimination 
procedure. Fourier-Motzkin elimination yields an analytically 
manageable number of rate bounds only for a relatively small 
number of rate splits. In this section we introduce a series 
of sub- schemes containing a limited number of auxiliary RVs 
and derive the corresponding Fourier-Motzkin eliminated rate 
regions (resulting in (i?i,i?2) rate regions) which are then 
compared to the outer bounds derived in Section Hill In ad- 
dition to these sub- schemes being more analytically tractable 
due to the small number of auxiliary random variables and 
rate-splits, these particular sub-schemes were chosen as they 
are natural extensions of schemes that achieve capacity when 
the IFC-CR reduces to specific classes of CIFC, IFC and BC 
channels. Table HIl illustrates the different sub-schemes and for 
which classes of channels this reduces to capacity. 

1) All private messages: scheme with only 
(Xi,X2,/7ipb, t/2pb)-' This sub-scheme is obtained by 
setting the rate of the common messages to zero. It illustrates 
the effect of binning performed at the cognitive relay to 
pre-code against the interference due to the non-intended 
message at each destination. 

Corollary IV.4. By considering Uic = U2c = Uoch = ^"^ 
Thm. \IV.I\ the following rate region is achievable 

i?i </(yi;Xi,C7ipb|Q)-/(X2;C/ipb|Xi,Q) (17a) 
R2 < I{Y2;X2,U2pb\Q) - I{X,;U2pb\X2,Q) (17b) 
Ri + R2< I{Yi;Xi, f/ipblQ) + /(Fa; X2, C/spblQ) 
- /(X2; [/ipb|Xi,Q) - /(Xi; C/2pb|X2,Q) 
-/([/ipb;C/2pb|Xi,X2,Q) (17c) 

for all the distributions that factors as 

PQPxi\QPx2\QPx,,Uipi,,U2ph\Xi,X2,Q' 

Proof: The proof may be found in Appendix [G1 ■ 

The graphical representation of the achievable scheme in 
Cor. IIV.4I is provided in Fig |3(a)| 

The scheme in Cor. IIV.4I achieves capacity (see Table lUl) 
when the channel reduces to a semi-deterministic BC [|45ll , 
II42I and to a semi-deterministic CIFC lUl; in these two 
cases the private broadcasted RV for the destination with 
noiseless output must equal the noiseless channel output; if 
both destination outputs are noiseless, the optimal assignment 
is /7ipb = Yi and U2ph = >^2. 

2) All common messages: scheme with only 
(/7ic, /72c, /7ocb)-' We now consider an achievability scheme 
where both decoders decode both messages and where, 
therefore, no binning or rate splitting is necessary. 





u- 



2pb 



X, 



(a) Scheme "all private messages" in Section HV-C II 




^1 




U' 



2c 




Ui 



Woct) 



U: 



2c 



(b) Scheme "all common messages" in Section IIV-C2I 



u 




ley 




u, 



2c 



(c) Scheme "one common and one private message" in Section IIV-C3I 



(d) Sche me "com mon from sources and private from relay messages" 
in Section lrV-C4] 



Fig. 3. Specific choice of RVs for the general coding sche me in Fig. [2] The missing nodes in each figure indicates that the associated auxiliary RV has rate 
zero. The remaining nodes are encoded as prescribed by Th. IIV.II 

TABLE II 
The capacity results available for BC, IFC and CIFC and the assignment of RVs in the region in ([12) that achieve the 

corresponding region. 



Sub-scheme # 


RVs used 


Capacity result 


Reference 


1 (all private) 


Xi,X2,t/ipb,C/2pb 


semi-deterministic BC, semi-det. CIFC 


[?], 1 1 1 


2 (all common) 


t/lc, t/2c, t/ocb 


very strong interference CIFC, IFC, IFC-CR 


1371, |3ir 


3 (one common, one private) 


t/lp,t/2c,t/ipb 


very weak CIFC 


il8i 


4 (common from sources, private from relay) 


t/lc, t/2c, t/ipb 


very weak CIFC 


118J 


Han and Kobayashi region 


Xi,X2, t/ic, U2c 


a class of deterministic IFC 


[33 


Marton region 


^Ocb, f^lpb, ^Ipb 


a More capable BC, BC with degraded message set 


[35J, [44r 



Corollary IV.5. By considering Xi = Uic^X2 = /72c, -^c = 
Uoch <^nd Uiph = /72pb = in Thm. MV.U the following rate 
region is achievable 

R,<I{Y^;X^,X,\X2,Q), (18a) 

R2<IiY2;X2,X,\X,,Q), (18b) 

Ri + R2<I{Yi;Xi,X2,Xe\Q), (18c) 

Ri + R2<I{Y2;Xi,X2,Xe\Q), (18d) 

for all distribution that factors as 

PQPxi\QPx2\QPxa\Xi,X2,Q' 

Proof: The proof may be found in Appendix |Hl ■ 

A graphical representation of the achievable rate region in 
Cor. [IV5]is depicted in Fig. [3(b)l 

This scheme achieves capacity (see Table |Il|) when the 
channel reduces to a CIFC in the "very strong interference" 
regime of I^TJ and to a IFC in the "strong interference" regime 

of EB. 



3) One common and one private message: scheme with only 
(Xi, /72c, /7ipb).* For a CIFC in the "very weak interference" 
regime, capacity is achieved by a fully common primary 
message and full private cognitive message ifTSll . We extend 
this transmission strategy to the IFC-CR by considering the 
case where one of the two source messages is private while 
the other is common. 



Corollary IV.6. By considering Uic = 



5X2 = /72c = 

/7ocb,/72pb = 0, /7ipb = Xc in Thm. \IV.1\ the following rate 
region is achievable 

Ri<I{Yi;XuX,\X2,Q), (19a) 

R2<I{Y2',X2\Q), (19b) 

R2<I{Y,;Xc,X2\Xi,Q)}}, (19c) 

Ri^R2<IiYi',X2,Xi,Xc\Q), (19d) 

for all distribution that factors as 

PQPxi\QPx2\QPx,,Uipi,\Xi,X2,Q' 



10 



Proof: The proof may be found in Appendix U ■ 

A graphical representation of the achievable rate region of 
Cor. [IV6]is depicted in Fig. [3(c)l 

This scheme achieves capacity (see Table |ll|) when the 
channel reduces to a CIFC in the very weak interference 
regime |18|. 

4) Common messages for the sources and private messages 
from the cognitive relay: scheme with only (t/ic, ^2c7 ^ipb)-' 
Here we aim to expand the scheme that achieves capacity 
it the "very weak interference" regime for the CIFC ifTSl 
(see Table HD by having the two sources transmit common 
messages while the cognitive relay sends part of a private 
message for source 1. 

Corollary IV.7. By considering Xi = Uic, X2 = U2c, Xc = 

^ipb. ^Ocb = ^ipb. U2ph = in Thm. \IV.1\ the following rate 
region is achievable 

i?i</(yi;Xi,Xe|X2,Q) (20a) 

Ri < I{Yi-X,\Xi,X2) + I{Y2;Xt\X2,Q) (20b) 



Ri 
Ri 
Ri 

i?i4 



R2<I{Yi;X2,Xc\X^,Q) 

R2<I{Y2;X2\Xi,Q) 

R2<I{Yi;Xi,X2,Xe,Q) 

R2<I{Yi;X2,Xe\X,,Q)- 

R2<I{Yi;Xe\Xi,X2,Q)- 



(20c) 

(20d) 

(20e) 

I{Y2;X,\X2,Q) (20f) 

I{Y2;X2,X2,Q) 

(20g) 

2R2 < I{Y,;X2,Xe\X,) + I{Y2;X,,X2,Q) (20h) 
for some distributions that factor as 

PqPxi\qPxi\qPx,\Xi,X2,Q' 

Proof: The proof may be found in Appendix IH ■ 

A graphical representation of the achievable rate region of 
Cor. UVTl is depicted in Fig. [3(d)l 

V. Capacity in "very strong interference at Rx 1" 

AND IN "STRONG INTERFERENCE AT BOTH RXS" 

In this section we show the achievability of the outer bound 
in Cor. IIII.4l in the "very strong interference at Rx 1" and the 
"strong interference at both Rxs" regime (to be defined later), 
which are two subsets of the "strong interference" regime 
defined by (|6]). These results parallel the "very strong inter- 
ference" capacity result for the IFC EH and the CIFC IITtI . 
where, the channel reduces to a compound two-user MAC. 
For this class of channels the interfering signal at each 
receiver can be decoded without loss of optimality. Since the 
interference can always be distinguished from the intended 
signal, there is no need to perform interference pre-coding 
at the cognitive relay. This greatly simplifies the achievable 
scheme required to match the outer bound in Cor. IIII.4I and 
the simple superposition coding scheme in Cor. IIV.5I will be 
shown to be optimal. 

Theorem V.l. Capacity in "very strong interference at 
Rx 1". // 

/(y2;X2,X,|Xi) </(yi;X2,X,|Xi) (21a) 

/(ri;Xi,X2,x,) </(r2;Xi,X2,Xe) (2ib) 



holds for all distributions that factor as Pxi,X2,Xc — 
PxiPx2Pxc\Xi,X2 (same factorization as in ^), then the 
region in Cor \IIL4\ is capacity. 

Proof: Under the condition in (12 lab (which is the same as 
the "strong interference at Rx 1" condition in (O) the region 
in ([8]) is an outer bound for the considered IFC-CR. Consider 
now the achievable rate region in Cor. IIV.5I given by ([TS]) . 
Under the condition in (I21bl) the sum-rate bound in (I18dl) is 
redundant and the resulting region coincides with the outer 
bound in dHJ). ■ 

Theorem V.2. Capacity in "strong interference at both 
Rxs". // 

/(r2;X2,X,|Xi) </(yi;X2,X,|Xi) (22a) 

I{Yi;Xi,Xc\X2) < I{Y2;Xi,Xc\X2) (22b) 

holds for all distributions that factor as Pxi,X2,Xc = 
PxiPx2Pxc\Xi,X2 (same factorization as in ©j, then the 
region in (fTSl) is capacity. 



Proof: The proof follows similarly to that of Thm. IV. 1 



VI. The Gaussian Case 

In the following, to obtain more of a feel for the channel 
model and the conditions under which capacity holds, we 
evaluate the "strong interference" outer bound conditions and 
the region in Cor. IIII.4I as well as the "very strong interfer- 
ence" capacity conditions and the region in Thm. IV. II for the 
Gaussian IFC-CR (G-IFC-CR). 



A. Channel Model 

The G-IFC-CR is shown in Fig.JH Without loss of generality 
(see Appendix [K| we can restrict our attention to the G-IFC- 
CR in standard form given by: 



Y2 = \h22\X2- 



\h2c\Xc 
\h2c\Xc 



■ ^12X2 + Zl, 
• ^21X1 + Z2, 



(23a) 
(23b) 



where hi e C, i e {11, Ic, 12, 22, 2c, 21}, are constant 
and known to all terminals, Zi ^ ?^c(0, 1), i G {1,2}, 
and IE[|Xip] < 1, i e {l,2,c}. The channel links hi,i e 
{11, 22, Ic, 2c} can be taken to be real- valued without loss of 
generality because receivers and transmitters can compensate 
for the phase of the signals. The correlation among the noises 
is irrelevant because the capacity of the channel without 
receiver cooperation only depends on the noise marginal 
distributions. 

B. Gaussian Channel under ''strong interference at Rx 1 " 
We now evaluate Cor. [mil and Thm. [VU for the G-IFC-CR. 

Theorem VI.l. The "strong interference at Rx 1" outer 
bound for the G-IFC-CR. // 

\h22\^h \h2c\\ hi2^p2 \hic\^ (24) 




Wi 



reduces to |/i2cP ^ l^icP (strong interference at the 
primary receiver) and the condition in (l27l) to 



+ 2||/iii||/iic 



\h2l\^-\h2c\^ 
-h2l\h2c\\ <0, 



W2^^-^X2 



Fig. 4. The Gaussian IFC-CR in standard form. 



for 

^P2 = ^{\h2c\\h22\ - \hlc\h12), 

\P2\'=1 „_J. II 



^ W2 



which is the same as the condition in [2. Thm.II.3]. 
When the IFC-CR reduces to a C-IFC with user 2 as 
primary user, i.e., \hii\ = /121 = 0, the conditions 
in (I24I and (l27]) are equivalent to I{Yi;X2,Xc) = 
I(Y2\X2,Xc) for all input distributions, that is. 



{hi2 
or 



= \h22\ 

{hi2-- 



\hic\ 

\h2c\ 



-- \h2c\} 

|/l22| = |/llc|}. 



(25a) 
if \h2c\ > \hic\ 



min < 1 



h2c\\h22\-\hlo\hi2\ \ .. I 1^17 

||/l2cP-|/llcP| J III 



When the IFC-CR reduces to a BC. i.e., \hii\ = /121 = 
1^22! = ^12 = the conditions in (|24]) and (l27l) 
are equivalent to /(yi;Xc) = /(F2;-^c) for all input 
distributions, that is, a BC with statistically equivalent 



Icl 

(25b) 
the capacity of a G-IFC-CR is contained in the set: 

Ri<G (||/in| + Pl\hi£ + |/iicP(l - \Pi\' + |/32p)) 

(26a) 

R2<Q {\\h22\ + /32*|/^2c||' + \h2c\\l - \f^lf + |/32|')) 

(26b) 

i^l + i^2 < e (\\hu\ + /3i*|/llc||' + \hi2 + /32*|/^lc||' 



receivers, i.e., |/i2c 



|/ii 



+ |/.l,P(l-|/3ip + |/32p)), 



(26c) Ri 



taken over the union of all (/3i,/32) G C^ : |/3ip + |/32p < 1, 
where Q{x) := log(l + x). 

Proof: The proof may be found in Appendix O ■ 

Theorem VI.2. Capacity in "very strong interference at 
Rx 1" for the Gaussian IFC-CR. 

If in addition to the condition in (1241) the following also 
holds 

{{\hlif + |/llcP + \hi2f) - {\h2l\^ + \h2c\^ + \h22f) 



Theorem VI.4. Capacity in "strong interference at both 

Rxs" for the G-IFC-CR. When the condition in (O along 
with the symmetric condition for source-destination pair 2 
hold, the region 

l/52p)), 
(28a) 

l/52p)), 
(28b) 

(28c) 



i?i < e (\\hu\ + ^t\hi£ + |/iiep(i - |/3i|'' + I/32I 

i?2 < e {\\h22\ + /32*l^2c||' + |/i2cP(l " I/?! |' + 



i?2<e(||/inH 

+\hic\\l 



■P*l\hlc\\' 



h\2 

2\ 



■/Sal^iic 



J?l+i?2<e(|/l2l+/?i*|/l2c| 



||/l22|4 
+ |/i2c|'(l-|/3l|' + |/32|')), 



P*2\h 



taken over the union of all {j3\ ^ P2) ^ C^ 
is capacity. 



2c\\ 

(28d) 



/l |2 I |2l 

2y ||/lii||/lic| - /l2l|^2c|| + Pl2|^lc| - |^22||^2c|| |< 

(27) 



then the region in (1261) is capacity. 

Proof: The proof may be found in Appendix [Ml ■ 

Remark VI. 3. Thm. IVI.2I reduce to known capacity results 
in the "very strong interference" regime when the IFC-CR 
reduces to a simpler channel: 

• When the IFC-CR reduces to an IFC, i.e., \hic\ = \h2c\ = 
0, the condition in (l24l) reduces to the well-known "strong 
interference at Rx 1" |/i22p ^ |^i2p, and the condition 
in (EH) to |/iiip + |/ii2p < |/i2iP + |/i22p (larger total 
received power at Rx 2 than at Rx 1). 

• When the IFC-CR reduces to a C-IFC with user 1 as 
primary user, i.e., I/122I = ^12 = 0, the condition in (l24l) 



Proof: The proof follows similarly to the one of 
Thm. IVLT] ■ 

Remark VI. 5. Thm. IVI.4I reduce to known capacity results 
when the IFC-CR reduces to a simpler channel: 

0, • When the IFC-CR reduces to an IFC, i.e., \hic\ = \h2c\ = 
0, the condition in (l24l) reduces to the well-known "strong 
interference" regime, {|/i22p < |^i2p, l^^iiP < |^2iP}. 

• When the IFC-CR reduces to a C-IFC with user 1 as 
primary user, i.e., I/122I = ^12 = or X2 = 0, inter- 
estingly, the "very strong interference at Rx 1" condition 
is equivalent to the "strong interference at both Rx's" 
condition. This can be seen by noticing that for X2 = 
the conditions in (I2TI) coincide with the conditions in (l22l) . 

• When the IFC-CR reduces to a C-IFC with user 2 as 
primary user, i.e., \hii\ = /121 = 0, we have the 
equivalent of case I/122I = ^12 = in the above bullet 
point but with the role of the users swapped. 

• When the IFC-CR reduces to a BC. i.e., \hic\ = \h2c\ = 
1^22! = hi2 = the "strong interference at both 
Rx's" condition and the "very strong interference at 
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Rx 1" conditions are the same and are equivalent to 
I{Yi]Xc) = I{Y2]Xc) for all input distributions, that 

is, \hic\ = \h2c\- 

C. Gaussian Channel under ''weak interference'' 

The condition in Q for the "weak interference at Rx 2" 
outer bound in Cor. IIII.5I is, in general, very hard to verify 
as it must hold for a large set of distribution involving an 
auxiliary RV. In this section we restrict attention to a special 
class of G-IFC-CR in which the condition in Q is easily 
verified, namely a class of "degraded" G-IFC-CR defined by 

h21 \h2c\ 



\hu 



\h 



Ic 



|p|e[o,i], 



(29) 



so that the channel input/output relationship becomes 



Fi = |/in|Xi + \hic\Xc + hi2X2 + Zi (30a) 

Y2 = \p\{\hii\Xi + \hic\Xc) + \h22\X2 + Z2. (30b) 

Since the noise correlation among the noises is irrelevant for 
capacity, conditioned on X2 we have the following Markov 
chain 



Xeq -^Yl^Y2 

\ 

»-eq 



(31) 



Xpn :— 1/^11 1-^1 + \hic\Xc^ 



Y2 - \p\Y, + yr^^^o, 

Zq ~ Nc(0, 1) independent of everything else, 



in other words, conditioned on X2, the channel in (|29l ) is 
equivalent to a SISO degraded BC with input Xeq. From (|3T1) 
and for any Pu,Xi,X2,Xc such that U -^ (Xi,X2,Xc) -^ 
(Yi, F2) we have that 

I{U;Y2\X2)<I{U;Y,\X2), 

which is exactly the "weak interference at Rx 2" condition 
in (O. 

Theorem VI.6. The "weak interference at Rx 2" outer 
bound for the degraded G-IFC-CR. For the degraded G- 
IFC-CR in (I29I) the capacity region is contained into the region 

i^i<e(||/in| + |/ii,|/3*|'a) (32a) 

R2<^(\P? Il/^lll + \hlc\Pl? + (1^221 + \p\\hlc\p2f) 

-e(|pp||/in| + |/iie|/3*|'a) (32b) 

R2<^[{\h22\^\p\\hic\Plf), (32c) 

taken over the union of all a G [0, 1] and (/3i,/32) such that 

Proof: The proof can be found in Appendix |n1 ■ 

Remark Nl.l. Special cases for the outer bound in Thm. IVI.6I 

• When I /lie I = 0. the channel in ([3Qb reduces to an IFC 
with "weak interference" at receiver 2 whose capacity is 
not known. The outer bound in Thm. IVI.6I in this case is 
looser than the outer bounds in 1461 , ll34ll . However, the 



Sato-type outer bound in Thm. IIII.ll reduces to B6ll and 
the tightened outer bound in |8| reduces to f34l. 

• When the IFC-CR reduces to a C-IFC with user 1 as 
primary user, i.e., I/122I = ^12 = 0, the channel in ([30b 
reduces to a Gaussian degraded CIFC |T| whose capacity 
is not known. The outer bound in Thm. I VI .61 in this case 
is looser that the outer bound in (I] Cor. 3.5]. In this 
case, the best known outer bound in |T, Cor. 3.5] is still 
of BC-type, from a MIMO BC with degraded message 
set however. 

• When the IFC-CR reduces to a C-IFC with user 2 
as primary user, i.e., \hii\ = 0, the channel in ([30b 
reduces to a Gaussian CIFC in weak interference JTSll 
whose capacity is known ifTSl . 1211 . The outer bound in 
Thm. IVI.6I in this case reduces to capacity. 

• When the IFC-CR reduces to a BC. i.e., \hn\ = /121 = 
1^22 1 = 0, the channel in ([3Qb reduces to a degraded SISO 
BC whose capacity is known |47|. The outer bound in 
Thm. IVI.6I in this case reduces to capacity. 

VII. Numerical Evaluations 

In this section we present a series of numerical evaluations 
of the results presented in the paper for the G-IFC-CR with 
real- valued inputs and real- valued channel coefficients. Using 
numerical examples, we investigate the relationship between 
inner and outer bounds as well as the position and extension of 
the "strong", "weak" and "very strong" interference regimes. 

In Fig. \5\ we depict 

• Fig. |5(a)[ the "strong interference at Rx 1" regime of ([24b 
and the "very strong interference at Rx 1" regime of ([27l) . 

• Fig. |5(b)[ the "strong interference at Rx 2" regime of ([24b 
and the "very strong interference at Rx 2" regime of ([27b . 

• Fig. |5(c)[ the "strong interference" regime of ([24b at Rx 1 
and at Rx 2 and the "strong interference at both Rxs" 
regime of Thm. IVI.41 

. Fig. [5(d)| the degraded G-IFC-CR of ^ and the "weak 
interference" regime of Thm. IVI.61 
for fixed hu = /122 = ^ic = ^2c = 1 on the plane [/112, h2i] G 
[-10,10] X [-10,10]. 

Since \hc\ = \hic\ = \h2c\, from ([25b we have that the 
"strong interference" condition becomes linear in /121 and hi2, 
i.e. condition ([24b becomes: 



\h- 



111 



\h: 



2c I 



< h 



^21 



\h: 



2c I 



(|/^ll|-/^2l)(|/^ll|+/^21+2|/l,|)<0 



(33) 
(34) 



Similarly, since \hc\ = \hic\ = \h2c\, the degraded condition 
at destination 1 in ([29b coincides with \hii\ = h2i'. from 
this consideration and given ([34b , we have that the degraded 
channel at destination 1 is also in "strong interference" at 
destination 2. Given the symmetry of the channel, we also have 
that the degraded channel at destination 2 is also in "strong 
interference" at destination 1. 
In Fig. [6] we plot the conditions 

/(ri;Xi,X2,X,) =/(r2;Xi,X2,X,) (35a) 

/(r2;X2,x,|Xi) = /(ri;X2,x,|Xi) (35b) 
/(ri;Xi,x,|X2) = /(r2;Xi,x,|X2) (35c) 
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(a) The "strong" (blue, hatched) and the "very strong interference at Rx 1" 
(blue, cross-hatched) regimes 
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(c) The "strong interference at Rx 1" (green hatched) and the "strong 
interference at Rx 2" (blue-hatched) regimes. 



(b) The "strong" (green, hatched) and the "very strong interference at Rx 2" 
(green, cross-hatched) regimes. 
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(d) The degraded the G-IFC-CR for Rx l(blue, dotted) and Rx 2 (green, 
dotted ) and the "weak interference" regime for Rx 1 (blue solid) and Rx 2 
(green solid) 



Fig. 5. Different parameter regimes for G-IFC-CR with hn = /i22 = 1, hic = /i2c = 2 and [/ii2, /i2i] ^ [-10, 10] x [-10, 10]. 



for increasing values of \hc\ = \hic\ = \h2c\ ^ [1,5] for 
fixed l/^-iil = |/?'22| = 1 on the plane [hi2,h2i] G [-10,10] x 
[—10, 10]. The line corresponding to each condition marks the 
boundary of the "strong interference" and the "very strong 
interference" conditions at destination 1 and 2. The darker 
hues are associated with smaller values of \hc\ while lighter 
hues with larger values. While the boundaries of the "strong 
interference" regime are always linear in /112, /121 for any \hc\, 
the "very strong interference" condition is approximated by an 
hyperbole for large /121 and hi2. 

In Figs. [71 [5] and |9] we compare inner and outer bounds for 
three points in the plane [hi2,h2i] G [—10 : 10] x [—10,10] 
for fixed \hii\ = I/122I = \hic\ = \h2c\ = 1 : 

• Fig- 13 (^12, ^21) = (—2, —2), where the Sato type outer 
bound of Thm. IIII.ll holds, but not the outer bounds of 
Thm. IVO or Thm. lyTgl 

• Fig.m (/112, h2i) = (—2, +1), where the Sato type outer 
bound of Thm. nil. 1] and the "strong interference at Rx 2" 
outer bound of Thm. IVI.ll hold; 

• Fig- El (^12, ^21) = (0.5, +1), where the Sato type outer 
bound of Thm. IIII.ll the "strong interference at Rx 2" 
outer bound of Thm. IVI.ll and the "weak interference at 
Rx 1" outer bound of Thm. IVL6l hold. 

In Fig. [7] we notice that a combination of common and 
private message, the scheme in Sec. IIV-C3I outperforms the 



schemes that utilize only common or only private messages, 
the schemes in Sec. IIV-CII and Sec. IIV-C2I respectively. 
Despite of the good performance of the scheme in Sec. IIV-C3I 
a substantial distance between inner and outer bound can be 
observed. The outer bound of Thm. IIII.2I is known to be 
capacity for the CIFC in "weak" interference, "very strong" in- 
terference and for the "primary decodes cognitive" regime ||2l. 
This result shows that the outer bound in Thm. IIII.2l is not tight 
far all the parameter region. 

Fig. [U shows that the "strong interference" outer bound 
of Cor. IIII.4I is tighter than the Sato-type outer bound in 
Thm. nil. 21 for some rate pairs. The scheme with one com- 
mon and one private message in Sec. IIV-C3I outperforms the 
schemes in Sec. IIV-C2I Sec. IIV-CII and Sec. IIV-C4I although 
the performance is comparable for some parameter values. 

In Fig. [9] we observe that the "weak interference" outer 
bound in lVI.6l is tighter than the Sato-type outer bound in IIII.ll 
for some rate pairs, although the "strong interference" outer 
bound of IVI.ll remains the tightest in this case. For this 
specific choice of parameters the channel is both in "weak 
interference" at destination 1 as well as in "strong interfer- 
ence" at destination 2. In this specific regime the scheme 
in IIV-C3I approaches the strong interference outer bound for 
some parameter values. Since Y2 is a degraded version of 
Yi conditioned on X2, loosely speaking, there is no loss of 
generality in having receiver 1 decode the message in X2 ; for 
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(a) The condition I{Yi;Xi,X2,Xc) = I(Y2;Xi,X2,Xc) for increasing hic = h2c 




I{Yi-Xi,X2,X,) = I{Y2-,XuX2,X,) 



I{Y2;X2,X,\Xi) = I{Yr,X2,X,\Xi 



(b) Tlie condition I(Yi;X2,Xc\Xi) = I(Y2; X2, Xc\Xi) for increasing hic = h2c 




I{Yi;Xi,X2,X,) = I{Y2;Xi,X2,X,) 



I(Y2;X2,X,\Xi) = I{Yi-X2,X,\Xi 



(c) The condition I(Yi;Xi,Xc\X2) = I(Y2;Xi,Xc\X2) for increasing hic = /i2c 
Fig. 6. The conditions in (|35) for |^ii| = I ^22 1 = 1 and hic = ^2c G {1 ... 5}. 
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Fig. 7. A plot for \hii\ = |/i22| = \hic\ = |/i2c| = 1 and hi2 = /i2i = -2. 
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Fig. 8. A plot for \hii\ = |/i22| = \hic\ = |/i2c| = 1 and hi2 = -2, /i2i = +1. 
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Fig. 9. A plot for \hii\ = |/i22| = \hic\ = |/i2c| = 1 and hi2 = .5,/i2i = +1. 



this reasons one expects the scheme in Sec. lIV-C3l to perform 
well in this case. 

VIII. Conclusion and Future Work 

We introduce new, general outer bounds for the IFC-CR 
that are inspired by capacity results available for the broadcast 
channel and the cognitive interference channel. We show the 
achievability of one outer bound in the "very strong interfer- 
ence" regime by having both decoders decode both messages 
as in a compound multiple access channel. This result is very 
similar in nature to the "very strong interference" capacity re- 
sults for the interference channel and the cognitive interference 
channel. We also derive the provably largest achievable rate 
region for this channel model by using classical random coding 
arguments such as rate splitting, superposition coding and 
binning. This region contains all the key transmission features 
using in achieving capacity in channels and classes of channels 
for which capacity is known. As such, this general achievable 
rate region is algebraically complex, but fairly general, and 
is shown to reduce to capacity for all sub-channels for which 
capacity is known. The contributions of this paper are a first 
step to a better understanding of the capacity region of the 
cognitive interference channel with a cognitive relay which 
remains largely undiscovered. 
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Appendix A 
Proof of Theorem Iiii.1I 

From Fano's inequality, if Pg ^ as A^ ^ oo then 

H(Wi\Y^^)<NeN with eAr ^ as A" ^ oo, 
with i e {1,2} and thus 

where the last inequality in the above expression follows from 
the independence of the source messages. 

The rate Ri can be bounded as in ([Tal) (and similarly for 
R2 in ([Tbb ) since 

<I{WuY,''\W2) 

Fano's inequality 
= H{Y,''\W2) - H{Y,''\WuW2) 

Definition of mutual information 
= H{Y,''\W2,X^{W2)) 

-H{Yf\Wi,W2,X^{Wi),X^{W2),X^{Wi,W2)) 

Deterministic encoding 

= H{Y,''\W2,X^) -Y,H{Yi,t\Xi,t,X2,t,X,,t) 

t 

Memoryless channel 

= ^H{Y,^t\W2,X^,Yl-')-^H{Y,^t\X,,uX2,uX,^t) 
t t 

Chain rule for entropy 

< Y,H(Yi^t\X2,t) -J2H{Yi,t\Xi,t,X2,t,Xe,t) 

t t 

Conditioning reduces entropy 

t 
Definition of mutual information 

= A-/(ri;Xi,A,|X2,Q), 
Introduction of time- sharing RV 

where, in the last equality, Q is a time sharing RV that is 
independent of all other RVs and uniformly distributed on [1 : 

N]. 



Next, let YI^ have the same conditional marginal distribu- 
tion as Y^^ , i G {1,2}. The Sato-type bound |91 sum-rate 
bounds in ([Tcb and ([Tdb follow since 



N{Ri + i?2 - 2eAr) 
<I{Yl';Wi\W2)^I{Yf',W2) 

Fano's inequality 
< HYl", Yi"; W^\W2)+ HYf; W2) 

Non-negativity of mutual information 

= I(Y^''-Wi\W2^Yi')^I{Yi'-Wr,W2) 

Y^ and Y^ have the same marginal cdf 
<J(ri^;Xf,Xf|f2^,Xf)+J(r2^;Xf,Xf,Xf) 
<N(^I{Yi;X,,Xe\Y2,X2,Q) + I{Y2;Xi,X2,X,\Q)), 



and where the last two inequalities follows from steps similar 
to the derivation of the bound on Ri above. 



Appendix B 
Proof of Theorem Iiii.2I 



The bound in (l3dl) , and similarly for (l3cl) but with the role 
of the users swapped, is obtained as follows 



N{R2 - cn) 
<I{Yi''.W2) 
Fano's inequality 

N 

= J2h{Y2,,\Y,%,) - H{Y2,,\Y,%„W2) 

i=l 

Chain rule for entropy 

AT 
<Y.H{Y2,^) - HiY2,^\Yr\Yi^^^,,W2^X2,^) 

Conditioning reduces entropy 

N 



of the users swapped, is obtained as follows 

N{R2 - cn) 

<I{Yi';W2\Wi) 



N 



Y,H{Y2,i\Yi;,+„WuX^,i) 



i=l 



H{Y2,^\Y^}^^,W2,X2,^,WuX^^,,X,^,) 



N 



<^H{Y2,,\Wi,Xi^,) 



i=l 



H{Y2,,\Y|-\Y^}^,,W2^X2,^,WuX,^,,X,^,) 



N 



N 



The sum-rate bound in (l3el) , and similarly for (jSj) but with 
the role of the users swapped, is obtained as 

N{Ri + i?2 - 2eAr) 
<I{Yl'',W^\W2)^I{Yi'',W2) 

N 

< J2 iiyi,u wuY2%,\Yr\w2,x2,i) 

i=l 

+ /(r2,,;H^2,X2,„F2'^+i) 

N 

= Y,iiyi,uy2%i\yr\w2,x2,i) 



(a) 



- Iiy2,^ 

^ ny^r 
^ ny2,. 

N 



Yr'\W2,X2,^,Y^}+^) 

Wi\Yi-\Y^%,,W2,X2,^) 

W2,X2,i,Yi^i+„Yr') 



J2 Kyi,u wi \Yr\Y2%i.w2,x2,i) 



i{Y2,i;y2%i,yr\w2,x2,i) 



N 



— ^^-'^(^l.ij Ui^i, Xi^i, Xc^i\Vi, U2^i,X2^i), 



i=l 



■I{y2,i;Vi,U2,i,X2,i), 



N 



= J2 Hyi,i-, ^i.i, Xc,i\Vi, U2,i, X2,i) + /(Fa.i; Vi, U2,i, X2,i) 



Y,Hy2,i-^Vi,U2,i,X2,i), 



i=l 



i=l 



where we defined 



Uu,^:=[Wu],ue {1,2}, 



where the equality in (a) follows from the "Csiszar's sum 
identity" [40]. Note that the Markov chain in (|4]) holds since 

for alH G [1 : A^] we have 

V^ ^ {Ul,^,U2,^) ^ (Xi,„ X2,., X,,,) ^ (Fl,,, 1^2,^) 

owing to the cognition structure and the memoryless channel 
that imply 

Pwi,W2,X^ ,X^ ,X^ ,Yf ,Yf 
N 

= Pw^Pw^U^iW^ - U^MW2 - U2,i)Px,,\u,,Px,,\u,,, 



The bound of (l3bl) , and similarly for (l3al) but with the role ^Xc,i|f/i,i,f/2,i^Vi,i,y2,i|^i,i)^2,i,Xc,i' 
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from which the factorization in (|5]) also follows. 

Note that we do not need a time sharing RV here since Q 
can be incorporated in the RV V without loss of generality. 

Appendix C 
Proof of Corollary IIII.4I 



Similar to BSl Lem. 4] and |36, Lem. 1], if the condition 
in ^ holds for all distributions in (|7]), then 

I{Y2;X2,Xe\XuU) < /(ri;X2,X,|Xi,C/), (36) 

for all PxuX^,x,,u = PxiPx^Pxc\x,,X2Pu\Xr,X2,x^- From 
this, it follows that when condition ^ holds, the bound in ( l3fl > 
may be upper bounded as: 

/(Fi; T/, f/i, Xi) + /(F2; f/2, ^2, Xe|y, C/i, Xi) 
= /(Fi; T/, f/i, Xi) + /(Fa; X2, Xe|y, C/i, Xi) 
< I{Y^■V,U^,X^) + I{Y^■X2,X,\V,U^,X^) 
= IiYi;X2,X,,V,Ui,Xi) 
= I{Y,;X,,X2,Xe), 

where the last equality follows from the Markov chain in (|4]) 

Appendix D 
Proof of Corollary IIII.51 



Consider dropping from the outer bound in Thm. IIII.2I all 
rate constraints but (l3al) , (l3dl) and (l3el) , i.e., consider the outer 
bound 

Ri<I{Y,;Xi,Xc\U2,X2), (37a) 

R2<I{Y2;V,U2,X2), (37b) 

(37c) 

We intend to show that when the condition in ^ holds for all 
distributions in ([TOl) , the region in (|37]) can be rewritten as 



Ri<I{YuX^,X,\V,U2,X2), 

R2<IiY2',V,U2,X2), 



(38a) 
(38b) 



which is equivalent to the region in (IllaMllbl) by defining 
U = [F, t/2]. Successively we show how the rate bound in 
(lllcl) can be added to the region in (|38]) to obtain a tighter 
outer bound. 

For any fixed Py,c/2,Xi,X2,Xc. the region in (1371) has three 
Pareto optimal points: 

. Pi = (0,(|37H)), 

. P9 = f(l3731)-(l37bl).(l37bl)). 

• P-^ = f(l37al).(l37cl)-(l37al)). 

. PA = f(l37a.Q). 

We now show that the outer bound in (|38]) contains each of 
these points. By considering the union over all the possible 
distributions Py,f/2,Xi,X2,Xc we can conclude that the outer 
bound in (|38]) is looser than (ITTl) . The corner points Pi,P2 
and P4 are also corner points of the region in (l38l) for the 



same Py,f/2,Xi,X2,Xc- Consider the region of (1381) for F = 0, 
then the corner point P3 is included in such region when 

/(r2;/72,X2)>/(r2;^,t/2,X2) + /(Yi;Xi,Xe|F,/72,X2) 

-/(ri;Xi,Xc|/72,X2) 
/(1^2;^|/72,X2)>/(ri;F|/72,X2)-/(ri;F|/72,X2,Xi,X,) 
I{Y2;V\U2,X2) > I{Yv,V\U2,X2), (39) 

where (l39l) follows from the Markov chain in ^. As for the 
App. O the result of |48, Lem. 4] and |36, Lem. 1] assures 
that condition in Q for [/ = F implies that 

/(i^2;^|t/2,X2)>/(ri;F|/72,X2), 

for any Px2,f/2,V' from which it follows that (l37l) is contained 
into (1381) when Q holds. Finally the rate bound in (lllcb is 



obtained from (lllbt by noticing that 

i?2 < /(r2;X2,x,|/7i,Xi) < /(r2;X2,x,|Xi) (40) 

The bound in (l4Qb is not required to prove capacity for the 
CIFC in "weak interference" tTSl . II2II but it can be tighter 
than (lllbl) for Gaussian IFC-CR in "weak interference" of 
Sec lVrcl 

Appendix E 
Proof of Theorem Iiv. II 

For easy of notation we omit the time sharing RV Q in the 
following. The coding scheme is as follows. 

• Class of input distributions 

Consider a distribution from ([T4l) . 

• Rate-splitting 

Each independent message Wi, i G {1,2}, uniformly 
distributed on [1 : 2^^*], is split into four sub-messages: 

- Wic : a common message transmitted by source i for 
both destinations, 

- Wip! a private message transmitted by source i for 
destination z, 

- ^icb- a common message transmitted by the cogni- 
tive relay to both destinations, 

- ^ipb • a private message transmitted by the cognitive 
relay to destination i. 

The sub-messages {W/e}/eG{ic,2c,ip,2p,icb,2cb,ipb,2pb}, 
are independent with Wk uniformly distributed on [1 : 
2NRk^ so that 

W^ = (I^ic, H^ip, l^icb, Wipb), (41a) 

Rl = Ric + i^ip + i^lcb + ^Ipb, (41b) 

W2 = (I^lc, W2p, H^2cb, W2pb), (41c) 

R2 = R2c + R2p + i^2cb + i^2pb. (41d) 

• Code-book generation 

Given any distribution in ([T4l) . the sources and the cog- 
nitive relay generate the following codebooks: 

- Common message: Wic G [1 : 2^^*^=] is encoded into 
U^{wic) with iid distribution Pu,,, i G {1,2}. 

- Private message: for a given Wic, Wip G [1 : 2^^*p] 
is encoded into X[^ {wip\wic) with iid distribution 
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- Common broadcasted messages: for a 
given pair (t^ic,^2c), the pair wich ^ 

[1 : 2^^1-b]^ ^2cb e [1 : 2^^2cb] j^ 
encoded into ^o^b/^icb, ^2cb, ^Ocbkic, ^2c), 
6ocb ^ [1 : 2^^ocb], with iid distribution 

PUoch\Ulc,U2c- 

- Private broadcasted message: for a 
given (^ic, W2c, ^icb, ^2cb, ^Ocb, ^ip), 
i^ipb G [1 : 2^-^'p^] is encoded into 

^i^b(^*pb5 ^ipbklc, ^2c, ^Icb, ^2cb, ^Ocb, ^ip), 

6ipb G [1 : 2^^^pb], with distribution 

^f/ipb|f/lc,f/2c,f/0cb,^^' ^ ^ {1'2}- 

Encoding 

Given k;i = (i^ip, i^ic, ^icb, ^ipb) and W2 = 

(^2p,^2c,^2cb,^2pb): 

- source 1 sends Xf{wip\wic). 

- source 2 sends X2^(k;2p|'^2c)- 

- First binning step: the cognitive relay looks for an 
index 6ocb such that 

([/l^Kc),XfKp|^le),/72^(^2c),Xf(^2pk2c), 
^O^b(^lcb, ^Icb, ^Ocbklc, W2c)) 
^^e {PUoch,Xi,X2,Uic,U2c) (42) 

If more than one such index satisfies the relationship 
in (l42l) . it selects one uniformly at random; if no such 
index exists, it sets 6ocb = 1 and in this case we say 
that a encoding error at the first binning step has 
occurred. 

- Second binning step: Let b^^^ be the index deter- 
mined at the first binning step. The cognitive relay 
looks for a pair of indexes (6ipb, ^2pb) such that 

([/l^Kc),XfKp|^le),[/2^(^2c),Xf(^2pk2c), 
^O^b(^lcb, ^Icb, ^Scbklc, ^2c), 

^l^b(^lpb, ^Ipbklc, ^2c, ^Icb, ^2cb, ^Scb^ ^Ip)^ 
^2^b('^2pb, ^2pbklc, ^2c, ^Icb, ^2cb, ^Ocb^ ^2p)) 

(43) 



e T^ (^f/lpb,f/2pb,f/0cb,Xl,^2,f/lc,f/2c)- 

If more than one such pair of indices satisfies the re- 
lationship in (1431) . it selects one uniformly at random; 
if no such pair exists, it sets (&ipb,^2pb) = (1^ 1) 
and in this case we say that a encoding error at the 
second binning step has occurred. 
- For the found triplet (^ocb' ^ipb' ^2pb) ^^^ cognitive 
relay sends a codeword 

^c (^Ipb , ^Ipb 1 ^2pb , ^5pb 1 

^Icb, ^2cb, ^Scb' ^Ic, ^2c, ^Ip, ^2p) 

jointly typical with all the selected codewords. 
Encoding error analysis 

Given the symmetry of the codebook generation, we can 
assume without loss of generality that the messages 

Wi = (l^ic, l^lp, l^lcb, Wlpb) = (1, 1, 1, 1), 
W2 = {W2c. 1^2p, 1^2cb, 1^2pb) = (1, 1, 1, 1), 



were transmitted. We now derive the conditions under 
which encoding is successful with high probability. Let 
also (^ocb' ^ipb' ^2pb) t>e the triplet found by the cog- 
nitive relay during the two binning steps of the encoding 
process. 

Let Ech, resp. £^pb, denote the event that the first binning 
step in (l42l) , resp. the second binning step in (|43]) , is not 
successful. The probability of encoding error is bounded 
by: 



Pr [encoding error] < Pr[£;cb] +Pr[£;pb|£;; 



cbJ 

where E^^ denotes the complement of the event Ech- 
We start by noting that the encoded sequences are gen- 
erated iid according to 

p(gen) A Pu^^^XiPu2c,X2Puoch\U2c,Uic 

f^lpb I f^2c , f^lc , f^Ocb 5-^1 f^2pb I f^2c , t^lc , f^Ocb 5^2 

(44) 

but after binning they look as if generated iid according 
to 



p(enc) ^ Pu^^,XiPu2c,X2Puoch\U2c,Uic,Xi,X2 

Uiph ,U2ph\U2c ,Uic ,Uoch ,Xi ,X2 5 



(45) 



we thus expect the encoding error probability to be of the 
form 



E 



log 



p(gen) 



p(enc) 

= ^(^Ocb;-^l7-^2|^lc7 ^2c) 

+ ^(^lpb;-^2|^lc, ^2c, ^Ocb) + ^(^2pb;-^l|^lc, ^2c, ^Ocb) 

+ /(/7ipb; /72pb|t/ic, /72c, t/ocb, Xi, X2). (46) 

The rigorous error analysis is as follows. 

- First binning step. Ech is the event that for all 6ocb ^ 

[1 : 2^^oc] 

(/7,^(l),Xf(l|l),/72^(l),X,^(l|l),/7o^,(l,l,6ie|l,l) 

T^ {PUic,XuU2c,X2,Uoch)^ 

By standard arguments, Pr[£^cb] ^ as A/" ^ 00 if 

^Ocb ^ H^l^^'2]Uoch\Uic,U2c)i 

as in (I15at . 

- Second binning step. Let b^^^ be the index that was 
found to satisfy (l42l) at the first decoding step. We 
bound the probability of error in the second encoding 
step as 

2^^'ipb 2^^2pb 

Pr[Epb|^,^b]=Pr[ n n (^i^(l),^f(l|l), 
61=1 62=1 

f/2^(l),Xf(l|l),C/o^b(l,l,&Scb|l,l), 

Vav[K] 



= Pt[K = 0] < 



E[if]2 
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where p(^"c) is given in (|45]) , where 



61=1 62=1 

with i^6i,62 the indicator function of the event 

(C/i^(l),Xf(l|l),f/2^(l),Xf(l|l),C7o^b(l,l,^Scb|l,l), 

C7i^b(l,&l|l, 1, 1, l.^Scb), t^2'^b(l,^2|l, 1, 1, l,6Seb)) 

The mean value of K (neglecting all terms that 
depend on e and that eventually go to zero as 

N ^ 00) is: 



^[^]= E E Pr[i^b„6. = 1] 

61 = 1 62 = 1 



with 



with 



2-^^ = Pr[i^5„52 = 1] = E[i^5„52] 

E 

pA^ pN 

^ 2-^[^(^lpb;^2|f/lc,f/2c,Xl,f/0cb)+/(f/2pb;^l|f/lc,f/2c,^2,f/0cb)] 
2-iV/(f/lpb;f/2pb|f/lc,Xi,f/2c,X2,C/ocb)]_ 

The variance of K (neglecting all terms that depend 
on e and that eventually go to zero as A/^ — > 00) is: 



-NB 



Pr[i^5„^=l|i^6„62=l] 

E 

<b^^i^(^^^"^^Kc,^f,<,^2^,<cb'<b) 

tdN 

^U2ph\U2c,Uic,Uoch,X2 
^ 2-^^(^2pb;Xi,C/ipb|C/2c,f/lc,X2,C/ocb) 

and similarly, i.e., swap the role of the users in the 
expression above. 



-Arc 



and finally 



-ND 



2-A^/(C/lpb;^2,f/2pb|f/lc,^l,f/2c,f/0cb) 



Pr[i^5;,^=l|i^6„62 = l] 



E 



(<b'<pb)^^i^(^^^"^^l<c,^r,<,^2^,<cb) 

pN pN 

Hence, we can bound Pr[i^ = 0] as: 

Pr[i^ = 0] 

1 + 2^^^ipb-^) + 2^(^2pb-^) + 2^(^ipb+^2pb-^) 
- 2^(^ipb+^2pb-^) 

and Ft[K = 0] ^ if 

^Ipb + ^2pb - ^ > 
^lpb+^2pb-^-(^2pb-^)>0 

^ipb + ^2pb - ^- (^ipb -C)>0 
that is, if 

^ipb + ^2pb > ^ = eq.dBdl) 
i^ipb > A - 5 = ea.ifBbb 
^2pb > A-C = eQ.([T53b 



smce 



Var[/^]= E E E E 
61=1 62=1 6;=i 6^=1 

(Pr[K5„62 = l,i^6;,^ = 1] -Pr[K5„62 = l]Pr[i^6;,6i = 1]) ^ = ^(^lpb;^2|t/lc, t/2c,Xi, t/ocb) 

< \^ Pr[i^ =11 +^(^2pb;^l|^lc,^2c,^2,^0cb) 

bi=b[,b2=b' + ^(^Ipb; ^2pb|^lc,-^l, ^2c,-^2, ^Ocb) 

= ^(^lpb;-^2|^lc, U2c,Xi, Uoch) + B 
= ^(^2pb;-^l|^lc, ^2c,-^2, ^Ocb) + C. 



=E[K] 



Y, Pr[K5„62 = 1] Pr[i^6„^ = l\Kb,M = 1] 



&l=&i,&27^&2 



=E[K]2^(^2pb-^) 



Decoding. We only describe the decoding at destination 1 
as the same applies to destination 2 with the role of 
the users swapped. Destination 1 looks for a unique 

^ PT[Kb^^b2 = 1] ^A^b[M = M^biM = 1] quadruplet (^ip, i^ic, ^icb, ^ipb) and for some quadru- 
biy^b[,b2^b'^ plet (^2c,^2cb,^0cb,^ipb) such that 

^" V ' 

Y^ PT[Kb,,b2 = l]Pr[i^6;,6^ = 11^61,62 = 1] ^0^bKcb,^lcb,^0cbklc,^2c), 

^l^b(^lpb, ^Ipbklc, ^2c, ^Icb, ^2cb, ^Ocb, ^Ip), 



biy^b[, 627^62 



.E[K]2^^^ipb + ^^2pb-^) 



(47) 
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where 

p(dest.l) 



E 



Uic,Xi-rU2c,X2 



Uiph,U2ph,Uoch,Xc\Uic,Xi,U2c,X2 



- Puic,XiPu2cPuipi,,Uoch\Uic,Xi,U2c (48) 

If none or more than one quadruplet 
(K;ip,K;ic,i^icb,^ipb) is found an error has occurred. 
Decoding Error Analysis. 

Let ^dest.i denote the event that the relationship in (l47l) 
is not satisfied by any (i^ip, Wic^ ^icb, ^ipb) or that is it 
satisfied by more than one such a quadruplet. We have 

Pr [decoding error] < Pr [encoding error] 

+ Pr[£^dest.i I encoding successful] , 

where Pr [encoding error] ^ if the rates are chosen 
form the "binning rate region" IRq defined by ([T2l) . Hence 
we only need to analyze the probability of decoding error 
assuming the encoding was successful. 
Table [IIIl summarizes the possible error events at destina- 
tion 1, where a "0" means that the corresponding message 
index is in error, a "/" that the corresponding message 
index, and bin index if any, is correct, and the ". . ." that 
is does not matter whether the corresponding message 
index is correct or not as in either case the joint density 
needed to evaluate the error event probability factorizes 
as if the message were in error (because of superposition 
to at least one codeword with a message index in error). 
For the cases where Uoch does not have the correct 
dependency on (/7ic, /72c,-^i), i.e., for all cases listed 
in Table |IIll but for event ^8 which is marked as "spe- 
cial", an intuitive analysis of the probability of error is 
as follows. Depending on which messages are wrongly 
decoded at destination 1 , and assuming the encoding steps 
were successful, the decoded codewords and the received 
Yi^ are iid jointly distributed according to 

^l|^ = PUic,XiPu2cPu^ 



0cb|f/2c,f/lc^f/lpb|f/2c,f/lc,Xi 



(49) 

where "^" in (l49l) indicates the set of correctly decoded 
messages. However, the actual transmitted codewords and 
the received Y^^ considered at destination 1 look as if 
they were generated iid according to 

Pi = PUic,XiPu2cPUoch,Uipi,\U2c,Uic,XiPYi\U2c,Uic,Xi,Uoch,' 

(50) 

Hence we expect the probability of error at destination 1 
to depend on terms of the type 

Pi 



density Pi|^ in (|49l ) must be modified as follows. We 
must use Puoch\U2c,Uic,Xi (i-^., correct dependency on 
{Uic, U2c^Xi)) rather than Pc/o,b|f/2c,f/ic- This results in 
the absence of the term /(/7ocb; -^i|^ic, ^2c) in (ISTI) . 
The rigorous analysis of the error probability is as fol- 
lows. 
- Pr[£^i] and Pr[£^2]' ^ic is in error. 

If the decoding of Uic fails, the codewords 
(Xi, [/icb, ^2cb, ^ipb) cannot be successfully de- 
coded since they are superposed to a wrong Uic. 
U2c, which is generated independently of /7ic, can 
be in error or not and we shall distinguish the two 
cases in the following. 

Event El in Table Uni corresponds to the case where 
both Uic and /72c are in error (and thus all the 
messages superposed to them are in error too); its 
probability can be bounded as 

Ft[Ei] = Pr y 

_Wlc9^l,W2c9^l,Wlp ,Wlch yW2ch ,'UJlph ,boch ,biph 

(Fi^, Ui'i{wic),Xj{wi^\wic), Uii{w2c). 

^O^b(^lcb, ^2cb, ^Ocbl^lc, ^2c), 

^l^b(^lpb,^lpb|^lc, ^Ip, ^Icb, ^2cb,^0cb) 

rz j^N /p{dest.l)\ 

^ 2N{Ric-\-Rip-\-R2c-\-Loch-\-Liph) 



/i|. =E 



log- 



ikJ 



■ E 



log 



Uoch\Ulc,U2c,Xi-t^Yl\U2c,Ulc,Xi,Uocl,,Ulpl, 



Uoch\Ulc,U2c-^Yi\^ 



I{Uoch;Xi\Uic,U2c) 



(51) 



(2yf ,nf, ,n2^, ,xf ,n^^^ ,nfp J GTjv (P(dest . 1) ) 



a) 



for Pi|^ given in (l5Qb and /i|^ given in dSTt evaluated 
for ^ = 0. Hence Pr[£;i] ^ as A/" ^ oo if ([T6al) 
holds. 

Event E2 in Table Hill corresponds to the case where 
Uic is in error (and thus all the messages superposed 
to it are in error too) and U2c is correctly decoded. 
Similarly to what done for event Ei , the probability 
of event E2 goes to zero if (I16bl) holds. 

- Ft[Es], Pr[E4] and FrlE^]: Xi is in error. 
Similarly to what done for event Ei, the probability 
of event Es goes to zero if (I16cl) holds, the probabil- 
ity of event E4 goes to zero if (I16dl) holds, and the 
probability of event E^ goes to zero if (I16fl) holds. 

- Pr[£^6] and Pr[£^7]: Uoch is in error. 

Similarly to what done for event Ei, the probability 



of event Eq goes to zero if ( |16g| ) holds, and the 
probability of event E7 goes to zero if (I16el) holds. 
- Pr[£^8]^ ^ipb is in error. 

Similarly to what done for event Ei , the probability 
of event £^8 goes to zero if (I16hl) holds. 



When Uoch has the correct dependency on (/7ic, /72c, ^i)^ 
i.e., only for the "special" event £^8 in Table Hill the 



Appendix F 
Proof OF Thm. UvjI 

Without loss of generality we may introduce in Thm. IIV.II 
a new RV 
{Uic, Uip), i.e. Xi = Xi{Uic, Uip), i e {1, 2}. 



Uip and let Xi be a deterministic function of 
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TABLE III 

Possible decoding errors at destination 1 . Legend: a "0" means that the corresponding message is in error, a "/" that the 

corresponding message is correct, and the ". . ." that is does not matter whether the corresponding message is correct or not as 

in either case the joint density needed to evaluate the error event probability factorizes as if the message were in error 
(because of superposition to at least one message in error). the event ^js is "special" in that the term i(uoch] ^l\ulc, u2c) in jstj 

must be omitted. 





Ulc 
Wlc 


U2c 
W2c 




t/ocb 

('U;icb,'i^2cb,^0cb) 


t/ipb 
('Wipb,^ipb) 


Set ^ to be used in 151J 


El 

E2 








/ 










U2c 


Es 

Ea 

E5 


/ 
/ 
/ 




/ 
/ 









/ 




Ulc 

Uic,U2c 

Ulc, U2c, Uoch 


Eg 

Er 


/ 
/ 




/ 


/ 
/ 







UicXi 

Uic,Xi,U2c 


Es 


/ 


/ 


/ 


/ 





UicXi , t/2c, f/ocb (special) 



TABLE IV 

The correspondence of RVs in the comparison between the 

region in [7 i and the region in ( [52^ . 



Region in f7 1 


Region in (152b 


Ui 


t/lc 


U2 


C/2c 


Vi 


t/lp 


V2 


C/2p 


Wi 


t/lpb 


W2 


C/2pb 



With 



Rn 



Ocb 



^Icb — ^2cb — ^Ipb — ^2pb — 0, /7ocb 



the achievable rate region in Thm. IIV.T1 given by ([T2l) becomes 
ii'ipb > ^(f^ipb; [/2p|C/ic, U2c, Uip) (52a) 

i?2pb > HU2ph; Uip\Uic, U2c, U2p) (52b) 

-^Ipb + -^2pb ^ -'^(f^lpb; U2p\Uic, U2c, Uip) 

+ I{U2pb;Uip\Uic,U2c,U2p) 

+ I{Ulph; t^2pb|f^lcj f^lp, U2C, U2p) 

(52c) 

Ric + R2c + Lip < I{Yi; Ulc, U2c, Uip, C/ipblQ) 

R2C + L1P < I{Yi;U2c,Uip,Uipb\Uic,Q) 

Ric + Lip < I{Yi- Ulc, Uip, Uipb\U2c, Q) 

Lip < I{Yi;Uip,Uipb\Uic,U2c,Q) 

Lip = Rip + -Ripb 

Ric + R2c + L2p < /(I2; Ulc, U2c, U2p, U2ph\Q) 

R2c + L2p < /(Fa; f/sc, U2p, U2pb\Uic, Q) 

R1C + L2P < I{Y2;Uic,U2p,U2pb\U2c,Q) 
L2p < I{Y2;U2p,U2pb\Ulc,U2c,Q) 
L2p = R2p + R2pb 

for all distributions that factors as 



(52d) 
(52e) 
(52f) 
(52g) 

(52h) 
(52i) 
(52j) 
(52k) 



PqPui,,Uip,Xi\qPu2c,U2p,X2\Q 

Uipb,U2pb,Xc\Uic,Uip,U2c,U2p,Xi,X2,Q- 



(53) 



In order to compare the special case of our achievable rate 
region given by ([52b with the region in |7|, consider the 
correspondence of RVs in Table [IVl With this correspondence 
we see that the regions in |7, (20)-(31)] and ([52b have the same 



rate bounds and holds for the same set of input distributions. 
Since the region in ([52b is a special case of our general 
achievable rate region, we conclude that the region in ([52b 
contains the region in IlZJ. 

Appendix G 
Proof of Corollary IIV.4I 

Let Ri = Rip and R2 = i^2p, i-^., 

Ric = R2c = ^Ocb — ^Icb = ^2cb = ^Ipb = ^2pb = 0. 

The region in ([T6b becomes 

R[p^>I{X2;Uip^\Xi) (54a) 

i?^pb>A^i;^2pb|X2) (54b) 

^Ipb + ^2pb ^ H^'2'-> ^lpb|-^l) + ^(-^i; ^2pb|-^2) 



+ /(t/ipb;/72pb|Xi,X2) 

^lp + ^'lpb^^(^l5^1'^lpb) 
^2p+i^2pb<A>'2;X2,/72pb) 



(54c) 
(54d) 
(54e) 



With 



i^ipb = /(X2; /7ipb|Xi) + ai, ai > 0, 

^2pb = ^(^1; ^2pb|^2) + a2, a2 > 0, 
ai +a2 = I{Uipi,;U2ph\Xi,X2), 

the achievable rate region in ([54b becomes 

I if i^ip</(l^i;Xi,/7ipb)-/(X2;/7ipb|Xi)-ai, 
^1 i^2p < I{Y2;X2, /72pb) - /(Xi; /72pb|X2) - a2, 

where the union is over all (ai,a2) G M^ such that 
ai -\- a2 = /(t^ipb; ^2pb|-^i7-^2), which coincides with ([TTb . 
Interestingly, we point out that the Fourier-Motzkin elimi- 
nation of the region with only (Xi, X2, /7ipb, t^2pb) and with 
^ipb ^ and i?2pb > is the same as with Riph = 
0,i^2pb = 0. 



Appendix H 
Proof of Corollary IIV.5I 

Let Ri = Ric and R2 = i^2c, that is 

^Ip = ^2p = ^Ipb = ^2pb = ^Ocb = 0. 
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The region in ([T6l) with Uiph = ^2pb = and 
/(Xi,X2; t/ocbl^ic, ^2c) = becomes 

i^ic + R2c < I{Yi; /7ic, /72c, Uoch. Xi) (55a) 

i^ic < /(ll;/7ic,t/ocb,Xi|/72c) (55b) 

i^2c + i^ic < HY2; /7lc, /72c, /7ocb,X2) (55c) 

R2c < /(1^2;/72c,/7ocb,Xi|/7ic) (55d) 

which coincides with the region in ([TSb by choosing Xi = 

/7ic,X2 = /72c, Xc = Uoch- 

Appendix I 
Proof of Corollary II V. 61 

Let Ri = Rip + i^ipb and R2 = i^2c, that is 

Rlc = i^2p = ^2pb = ^Ocb = 0. 

The region in ([T6b with Uic = 0, X2 = /72c, /7ocb = /72c and 
/72pb = /7oc becomes 



loss of generahty that all the entries of (Pi,P2,^c,cr^,cr2) 
are strictly positiveo consider now the transformation 



Xi 



1^2 = ^e-^'^^- 

^^2 



Xi = 



X, 



^-j(Z^ll+Z^l,) J^ ^ ^2 ^-7(Z/l22+Z^2c) 



X, 



|/^lc| = 



^Pll/^ 



111 



^P2l/^: 



2K^22| 



H2| 



-R2C + -Rip + -Rlpb < -^(^1; -'^l, t^2c, t^lpb) 


(56a) 


i?2c + i?lpb < /(ll; f/2c, f/lpb|f/lp) 


(56b) 


i?lp + i?lpb < I{Yi;Uip, f/lpb|C/2c) 


(56c) 


^lpb</(i"i;C/lpb|Xl,t/2c) 


(56d) 


i?2c</(i"2;C/2c). 


(56e) 



CTl 
'P2hl2 

e 



-jZ/ii 



^22 



I2c\ 



121\ 



Cf2 

'Pc\h2c\ 

cr2 

'Pih2i 

e 

cr2 



-jZh2 



which coincides with the region in ([T9l ) by choosing X2 

/72c, Xc = /7ipb. 



Let Ri 



Appendix J 
Proof of Corollary IIV. 7 1 

Rlc + i^ipb and R2 = R2c, that is 



R 



ip 



i?- 



2p 



^2pb 



^2pb 



The region in ([T6l) with Xi = /7ic,X2 
and /72pb = /7oc becomes 



^Ocb = 0. 
= /72c, /7ocb 



i^ 



i^lc + R2c + i^lpb < /(n 
R2c + i^lpb < /(n 

+ i^ipb < I{Yi 
Riph < I{Yi 



Ic 



^Ic 



R, 



R2c < HY2 

R2c < 0X2 

<IiY2 



/7ic, /72c, /7ipb) 
/72c, /7ipb|/7ic) 
/7ic, /7ipb|/72c) 
/7ipb|/7ic, /72c) 

/7lc,/72c) 
/72c|t/lc) 
/7lc|/72c). 



which coincides with the region in ([2Qb by choosing 

/7lc,X2 = /72c, Xc = /7lpb . 

Appendix K 
The IFC-CR in standard form 

A general IFC-CR is expressed as 

Yi = hiiXi^hicXc^hi2X2^Zi, 

% = h22Xi + h2cXc + h2lXi + Z2, 



= /72c 

(57a) 
(57b) 
(57c) 
(57d) 
(57e) 
(57f) 
(57g) 

Xi = 



Since the above transformation is invertible, the channel 
in ([58]) is equivalent to the channel in ([23]). 



Appendix L 
Proof of Theorem [VLT] 

Given the "Gaussian maximizes entropy" property |50| we 
have that the union over all the distributions in ^ of the 
region in ([5]) is equal to the union over all distributions with 
(5 = and [Xi , X2 , Xc] zero-mean proper-complex Gaussian 
with covariance matrix 

/I /3A 

Cov(Xi,X2,X,)= 1 /32 :=S, (59) 

\Pt Pi 1/ 

for {pi, 132) e C^ such that |/3ip + |/32p < L With ([59]) we 
write: 



X, = /3*Xi + /32*X2 + Vl^W^TWXc^in. 

for Xi,X2,Xc,in. lid K(0, 1), from which 

Yj = [hji ^ Pl\hjc\]Xi + [hj2^p2\hjc\]X2 

+ |/i,c|Vl-|^iP + l/^2PX,,,,. + Z„ JG{1,2}. 
and thus, conditioned on Xi, we have that K, is distributed as 



(58a) 
(58b) 



for hi, i e {11, 22,1c, 2c, 12, 21}, E[|X^f] < P^-, j G 
{l,2,c} and IE[|Z/ep] = al, k e {1,2}. Assuming without 



[hj2^p2\hjc\]X2Mhjc\V^ - |/3iP + |/32PXc,.n.+^„ j G {1,2}. 

^ If J^i = 0,P2 = 0, Pc = the channel capacity is trivially Ri = R2 = 
0. If Pi = 0, P2 = 0, Pc > the channel is equivalent to^a Gaussian BC 
with input Xc whose capacity is known |47 1. If Pi = 0, P2 > 0, Pc = 0, 
and similarly if Pi > 0, P2 = 0, Pc = 0, the channel is^ Gaussian point-to- 
point channej^ whose capacity is known |49 1. If Pi = 0, P2 > 0, Pc > 0, and 
similarly if Pi > 0, P2 = 0, Pc > 0, the channel is equivalent ^o a Gaussian 
CIFC whose capacity is known to within 1 bit 1 2 1. If Pi > 0, P2 > 0, Pc = 
0, the channel is a Gaussian IFC whose capacity is known to within 1 bit |34|. 
If either of the noise variances is zero, the corresponding channel has infinite 
capacity, which does not have any physical meaning. 
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Since the condition in © must hold for all (/3i ,132) G C^ such 
that |/3ip + |/32p < 1, we obtain 

for all Gaussian mputsI{Y2;X2,Xc\Xi) < I{Yi;X2,Xc\Xi) 

e{\\h22\ + P*2\h2c\? + \h2c\Hi - |/5l|' + 1/521')) 

< e(|/li2 + /?2*|/llc||' + \hle\'{l - lAl' + m')) 

^^V(/?i,/?2)eC2:|/?i|2 + |/?2|'<l 

\h2cf{l - |/3l|') + \h22f + 2\h2c\\h22\n{p2} 

< |/iicP(l - |/3iP) + I/112P + 2|/iic|5R{/ii2/32} 

i/iie^a-iAp) 



We next show that, given A> and -B > 0: 

\/A2 + i?2 = max{a;A + yS} si. x^ H 



r <i 



1) 



max {(|/i2c| 

l/3iP + lftP<l 
■2SR{(|/l2c||/l22|-|/llc|/ll2)/32}}<|/ll2|' 

- niax{(|/i2c|'-|/Mcn(l-|/3iP) 

l/5ir<i 



|/i: 



Indeed, for t > let the Lagrangian be: 

L = xA^yB - 2/t{x^ + y'^ 

then at the optimal point 

dL/dx = A- x/t = ^^ X = At 
dL/dy = B -y/t = ^^ y = Bt 

hence the optimal Lagrangian multiplier is 

2\i2 



22 I 



j/^ = (A^ + 5^)t^ = l^^t = 



1 



VA^ + 52 



|/^2c||/^22| - |/^lc|/^12 Vl-IAP} < 1^121' - \h22f 

where in the last step the optimal /32 is 

62 = e~J^*^l^2c||/l22|-|/llc|/ll2) /]_ _ 1/3-^12^ 

Let now 



\/l-|/5iP=a;, 
|^2c|' - \hic\'^ =a, 

\h2c\\h22\ - \hlc\hl2 



\b\. 



Appendix N 
"Weak interference" outer bound for the IFC-CR 

We now evaluate the "weak interference at Rx 1" outer 
bound in Cor. IIILSl for the channel model in (l30l) . We proceed 
as in ifTSl . We must evaluate the region 

Ri<I{Yi;Xi,Xc\X2,U) 

= h{Yi - hi2X2\X2,U) -\og{7re), 
R2 < I{Y2;X2, U) = h{Y2) - h{Y2\X2, U) 

< log(Var[r2]) - [HY2 - \h22\X2\X2,U)-\og{7re)], 



The quadratic function f{x) = ax'^ + 2\b\x is non-decreasing for all distribution that factors as in ([T0|. As for the El Gamal's 
in X G [0, 1] if ax + \b\ > 0. If a > 0: +|a|x + |6| > for converse for the degraded BC we have 
all X e [0,1] hence x = 1 is optimal. Else (i.e., if a < 0): 



-\a\x + |6| > for x < \b\/\a\. Thus, if a < 0, |6|/|a| < 1: 
X = \b\/\a\ G [0,1] is optimal, and if a < 0, |6|/|a| > 1: x = 1 
is optimal. This shows the optimal /32 is the one given in (1251) . 

Appendix M 
Proof of Theorem [vO] 
With the parameterization in (l59l) the condition in (I21bt can 
be rewritten as 

for all Gaussian inputs : /(Yi; Xi,X2,Xc) < 7(^2; ^1,^2, ^c) 

^^y{Pup2)eC':\P,\'^\p2\'<l 

e(||/ln|+/3*|/lie|P + |/ll2+/32*|/^lc|P 
+ |/lle|^l-|/3i|2 + |/32|^)) 



h{Zi) = /i(ri|Xi,X2,X,) < h{Y,\X2U) < h{Yr - /112X2IX2) 
^^ log(l) < h{Y^\X2U) - logM 
<log(l + Var[Xeq|X2]), 

where Xeq := |/?^ii|Xi + \hic\Xc as defined in (|3T1) . 
Hence there must exist an a G [0, 1] such that 

h(Y^\X2U)-\og{^e) 
= log(l + aVar[Xeq|X2]). 

Moreover, since conditioned on X2 the channel in (l30l) is 
degraded, the (scalar) Entropy Power Inequality (EPI) lISTl 
for complex- valued RVs grants 



<e(|/l21+/3i*|/l2c| 



\h' 



22 I 



H*2\h 



2c\ 



■ {\hll? + \h^c? + \hl2?) - {\h21? + \h2c? + \h22?) 

^^m^^^^^m{f3^{\h^,\\h^^\-\h2c\h2l) 



+ /?2(|/llc|/ll2-|/l2c||/l22|))<0 



2 max { 

|/3lP + |/32|2<l 



Pi 



211 ^\h2c?^\h22?) 

hic\\hii\ - \h2c\h21 



P2 



\hic\hi2 - \h2c\\h22\ 



}<0 



(|/^ii|' + \hic? + \hi2?) - (\h21? + \h2c? + \h22?) 



\hic\\hi 



\h2c\h 



21 



\hic\h12 - \h2c\\h2 



>|^|22/.m|X2,f/)^(l_|^|2)2M^o) 

which implies 

h{Y2\X2, U) - log(7re) > log (l + aVar[Xeq|X2]) . 

With this we obtain 

i?i<e(aVar[Xeq|X2]), 

i?2 < e (Var[|p|Xeq + \h22\X2]) - e (a|p|2Var[Xeq|X2]) . 

Moreover, from ([Tbl) we also have 

i?2</(l2;X2,Xe|XiQ) 

<0. <log(l + Var[F2-|p||/iii|Xi l^i])- 
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By considering the input covariance S defined in ( l59t . for a 
fixed (/3i,/32) : |/3iP + \p2? < 1 we obtain 

Var[Xi + |p|X, 1X2] 

= l + \p\\l-\l3,\^) + 2\p\^{l3,} 

Var[|/i2i|(Xi + |/o|Xe) + 1/1221^2] 

= |/l2l|'(l+|H') + |/l22|' + 2|/l2l||/l22||p|3?{/32} 
<|/l2l|'(l+|p|') + |/l22|' + 2|/l2l| I/I22I IpI |/^2| 



< |/I2l|'(l + IpI') + I/122P + 2\h2l\ \h22\ \p\ VT^^ 
Var[|/l2l||p|Xe + |/l22|X2 |Xi] 

= \h2l\^\p\^{l - |/?l|2) + I/I22I' +2|/l2l||/9||/l22|K{/?2} 
<|/l2l|'H'(l-|/?l|') + |/l22|'+2|/l2l| \p\ \h22\ |/?2| 



<|/t2inpp( l-|/?l|^) + |/t22p+2|/l2l| IpI I/I22I Vl-|/3lP 
= (|/i2l|H\/l-|/3lP + |/l22|f 

Note that the above shows that we can only consider |/3ip + 
|/32p = 1 without loss of generality. With this, we obtain the 
region in (l32l) . 



